tooz.drivers.memcached Unable to heartbeat by updating key '__TOOZ_LOCK_cinder*** with extended expiry of 30 seconds

asked 2019-05-13 01:00:31 -0600

Hello, My use case is: made 300 simple 1Gb volumes, and when deleting them all, I do cirros Virtual Machine create. This goes for minutes. While same creation of VM took 30 second only.

It always awats on creating of block device,

"nova.virt.block_device [req-e72a9e60-cc39-401a-bda3-eabf1193fad6 20ae61239e464709881630f45c51344f b6dbb7b6a20048a38d7b47904a408f7f - default default] Creating volume took 459 seconds"

So, I tried to notice and tune tooz. But no chances. 30 seconds or 360, nevermind.

"WARNING tooz.drivers.memcached [req-951035dd-f9a6-4a6e-8b4a-e6fadc06d51f 20ae61239e464709881630f45c51344f b6dbb7b6a20048a38d7b47904a408f7f - default default] Unable to heartbeat by updating key '__TOOZ_LOCK_cinder-df342b70-0d50-40d8-bfe5-bf2d14977111-delete_volume' with extended expiry of 360 seconds"

Could you please suggest further debugging or performance tuning places here? Thank you in advance,

edit retag flag offensive close merge delete