Ask Your Question
0

Heat engine crashed

asked 2015-03-09 00:34:36 -0500

Vinoth K G gravatar image

updated 2015-03-09 12:36:59 -0500

larsks gravatar image

We observed heat api and heat engine crash in our environment. The process got terminated abruptly. Any help will be very useful.

We are using icehouse

Here is the heat-engine crash log:

ERROR heat.openstack.common.threadgroup [-] [Errno 5] Input/output error
TRACE heat.openstack.common.threadgroup Traceback (most recent call last):
TRACE heat.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/heat/openstack/common/threadgroup.py", line 121, in wait
TRACE heat.openstack.common.threadgroup     x.wait()
TRACE heat.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/heat/openstack/common/threadgroup.py", line 49, in wait
TRACE heat.openstack.common.threadgroup     return self.thread.wait()
TRACE heat.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 173, in wait
TRACE heat.openstack.common.threadgroup     return self._exit_event.wait()
TRACE heat.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 121, in wait
TRACE heat.openstack.common.threadgroup     return hubs.get_hub().switch()
TRACE heat.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 293, in switch
TRACE heat.openstack.common.threadgroup     return self.greenlet.switch()
TRACE heat.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 335, in run
TRACE heat.openstack.common.threadgroup     self.fire_timers(self.clock())
TRACE heat.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 459, in fire_timers
TRACE heat.openstack.common.threadgroup     self.squelch_timer_exception(timer, sys.exc_info())
TRACE heat.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 383, in squelch_timer_exception
TRACE heat.openstack.common.threadgroup     traceback.print_exception(*exc_info)
TRACE heat.openstack.common.threadgroup   File "/usr/lib64/python2.6/traceback.py", line 124, in print_exception
TRACE heat.openstack.common.threadgroup     _print(file, 'Traceback (most recent call last):')
TRACE heat.openstack.common.threadgroup   File "/usr/lib64/python2.6/traceback.py", line 13, in _print
TRACE heat.openstack.common.threadgroup     file.write(str+terminator)
TRACE heat.openstack.common.threadgroup IOError: [Errno 5] Input/output error
TRACE heat.openstack.common.threadgroup
edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted
0

answered 2015-03-09 15:52:48 -0500

That's a very generic I/O error - is there nothing in that or any of the other logs immediately preceding it?

My suspicion would be a disk write error somewhere - either something as simple as a node running out of disk space, or perhaps a connectivity problem. Without more log information it's not possible to say for certain though.

edit flag offensive delete link more

Comments

I couldn't paste the complete log. Have uploaded in google drive

https://drive.google.com/file/d/0BwDO...

One thing we are sure is, it's not running out of disk space.

Vinoth K G gravatar imageVinoth K G ( 2015-03-09 23:31:34 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2015-03-09 00:34:36 -0500

Seen: 237 times

Last updated: Mar 09 '15