Neutron consuming high CPU

asked 2019-05-15 10:08:24 -0500

Robby gravatar image

updated 2019-05-16 04:10:12 -0500

I am running a 3 node controller cluster with haproxy and mysql galera, and two compute nodes in pike. Although there is no load, i see neutron consuming a high cpu, I searched in google but finding nothing, Any ideas on tuning will be much apreciated.

Each controller: CPU(s): 24 On-line CPU(s) list: 0-23 Thread(s) per core: 2 Core(s) per socket: 6 Memory : 94 GB

Compute nodes : CPU(s): 40 On-line CPU(s) list: 0-39 Thread(s) per core: 2 Core(s) per socket: 10 Memory : 250GB

pstree of neutron-server :

systemd(1)───neutron-server(9212)─┬─neutron-server(13855) ├─neutron-server(13856) ├─neutron-server(13857) ├─neutron-server(13859) ├─neutron-server(13861) ├─neutron-server(13862) ├─neutron-server(13863) ├─neutron-server(13865) ├─neutron-server(13867) ├─neutron-server(13869) ├─neutron-server(13870) ├─neutron-server(13873) ├─neutron-server(13875) ├─neutron-server(13877) ├─neutron-server(13878) ├─neutron-server(13879) ├─neutron-server(13882) ├─neutron-server(13883) ├─neutron-server(13886) ├─neutron-server(13887) ├─neutron-server(13888) ├─neutron-server(13891) ├─neutron-server(13892) ├─neutron-server(13893) ├─neutron-server(13894) ├─neutron-server(13897) └─neutron-server(13898)

Top command output :

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
13894 neutron 20 0 453812 138808 2248 R 89.5 0.1 713:54.25 /usr/bin/python2 /usr/bin/neutron-server --config-file /usr/share/neutron/neutron-dist.conf --config-dir /usr/share/neutron/server --c+

I read reducing report intervel of agents will help, any practical experiences?, please share on what exactly can be tuned without causing problems in future?

edit retag flag offensive close merge delete

Comments

Please use code format for your output, you can edit your question and use the code format button, that makes it readable for others. Please also provide more details on your environment, number of control/compute nodes, their resources (RAM, CPU), are the neutron services up and running?

eblock gravatar imageeblock ( 2019-05-15 10:31:23 -0500 )edit

I would also have a look at the neutron server log.

Bernd Bausch gravatar imageBernd Bausch ( 2019-05-15 19:34:45 -0500 )edit

I don't see anything in server logs or agent logs its all like this for all pid's

13892 INFO neutron.wsgi [-] ip "OPTIONS / HTTP/1.0" status: 200 len: 247 time: 0.0017378 13887 INFO neutron.wsgi [-] ip "OPTIONS / HTTP/1.0" status: 200 len: 247 time: 0.0018160

Robby gravatar imageRobby ( 2019-05-16 05:39:11 -0500 )edit