Ask Your Question
3

mysqld server 100% cpu

asked 2013-05-21 13:30:35 -0500

NicCOConnor gravatar image

So I made a bit of an error while testing out my system. I have a pretty powerful blade running all services, and I wanted to stress test it by rolling out 80 instances. this seems to have caused mysqld to crap out and utilize 100% of the processors which is pretty impressive since there are 4 XEON 10 core processors in the blade. I believe this could have something to do with quantum and it's default quota of 50 ports, however I've been at it all day and I can't seem to figure out how to reset the system. I've tried deleting all the instances and the process is slow and error prone. Almost every VM is in an error state or deleting state.

nova list takes about 20 minutes to run. horizon takes about an 20 minutes to list instances almost all are in error or deleting state. mysqld utilizing 100% cpu (htop) tried clearing rabbitmq-queues for nova and quantum. no luck. Reboot server has same issue. I've checked the logs but I really can't decipher what exactly is holding up the system. The system is offline so I can't really post logs, without jumping through some bureaucratic hoops.

Right now I'm contemplating dropping the nova and quantum databases and re-initializing them but I'm not sure what the adverse effects are.

Can anyone shed some light on how to resolve an issue like this.

Nic

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted
1

answered 2013-05-26 12:58:42 -0500

spcla1 gravatar image

updated 2013-05-26 13:03:02 -0500

Hi Nic,

I have the same problem and I always see MySQL cpu usage goes up to more than 100%. Everything is slow, nova and quantum commands take a long time to display the result. Clicking options from the dashboard is also very slow. Found out that keystone is writing a lot of queries and changing an option on the my.cnf file is recommended.

Check this out, this might help with your problem. This actually helped solve my problem.
https://bugs.launchpad.net/keystone/+bug/1182481

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

Stats

Asked: 2013-05-21 13:30:35 -0500

Seen: 1,046 times

Last updated: May 26 '13