Bucket creation callback

alon.schachter · June 18, 2018, 4:33pm

Hi,

I am trying to create some buckets, and then create a GSI index on one of them.

I noticed that I always get an “authentication error” on “get bucket” operation.
And then I realized that I need to wait a while after creating the bucket so that it finishes “warming up”.
So if i throw a Thread.Sleep(some seconds) before trying to to the “get bucket”, it works.

Is there a better way to know when the bucket is ready to be accessed?

btburnett3 · June 18, 2018, 4:58pm

@alon.schachter

I’ve monitored the REST endpoint /pools/default/buckets before, waiting for all nodes to show status of “healthy” for the bucket:

github.com

brantburnett/couchbasefakeit/blob/master/scripts/configure-node.sh#L69


	# Create buckets defined in /startup/buckets.json
	echo "Creating buckets..."


	while read bucketSettings
	do
		curl -Ss http://127.0.0.1:8091/pools/default/buckets -u "$CB_USERNAME:$CB_PASSWORD" $bucketSettings
	done < <(cat /startup/buckets.json | jq -r '.[] | to_entries | map(.key + "=" + (.value | tostring)) | @sh "-d " + join(" -d ")')


	# Wait for the buckets to be healthy
	bucketCount=$(cat /startup/buckets.json | jq -r '.[].name' | wc -l)
	until [ `curl -Ss http://127.0.0.1:8091/pools/default/buckets -u $CB_USERNAME:$CB_PASSWORD | \
			 jq -r .[].nodes[].status | grep '^healthy$' | wc -l` -eq $bucketCount ];
	do
		echo "Waiting for bucket initialization..."
		sleep 1
	done


	# Run fakeit
	while read bucketName
	do
		if [ -e "/startup/$bucketName/models/" ]; then

However, I’ve also found that isn’t 100% accurate, as there are some other async processes of some kind still occurring. So I typically throw in an extra little wait afterwards, or I actually try to bootstrap the SDK and see if I can access the bucket I need to be 100% certain.

Brant

alon.schachter · June 20, 2018, 8:09am

Thanks.

I would consider adding a synchronous option for creating buckets which would return only once the bucket is ready or adding a callback.