How does reducing replicas work?
Hi everyone!
Our Swit cluster has two region and we were using 4 replicas. Region 2 has more devices.
We decided to reduce it to 3 replicas. We setup the ring and deployed it. Everything went fine. But a after few hours, disk usage on Region 1 started to increase and disk usage on Region 2 started to decrease. After 24 hours Region 1 disk usage started to decrease and become very close do Region 2.
(http://imgur.com/looXsTA)
Can someone explain why this behaviors happened? Does it have any relation with min_part_hours (24 hours) ? Even if it has, why would it increase on one region instead of just maintain the same usage?
I thought, after the reduction, swift would just remove the extra copies.
PS: we had not outage and nobody complained about anything. I just want to understand a little bit more how swift works.