Buckets_shutdown_wait_failed - Rebalancing never ends

Couchbase Server
1

I am continuously getting this in log and rebalancing never ends …
Any tip how to recover from this rather re-building the cluster ?

Rebalance exited with reason {buckets_shutdown_wait_failed,
[{‘ns_1@cb-cluster-0003.ldc-cluster.bi-cb.svc’,
{‘EXIT’,
{old_buckets_shutdown_wait_failed,

thanks

2

I ran into this same thing and ended up starting couchbase-server twice and then retrying the rebalance.

3

How did you do that restart ? I am running CB server in K8s POD 's which is in Debian Linux distros

4

I guess that would be a restart of the pod. You will need to find the node it is running on and manually restart the container. You might also try just killing the pod and it should be rescheduled again. This will likely delete your data as well.

5

Hi,
I’ve just noticed the same issue during rolling upgrade of big production cluster.
Couchbase version: Couchbase Server Community Edition 6.5.1 build 6299

I’ve found similar issue described in your jira ticket https://issues.couchbase.com/browse/MB-29639?page=com.atlassian.streams.streams-jira-plugin%3Aactivity-stream-issue-tab
From ticket it looks that it should be resolved, are you able to provide some info how this error could be avoided?