Hi,
I use Couchbase 6.5.1 and currently evaluating a case for our application.
I created a bucket with 50M of small documents (JSON with the long numbers), all documents have the same schema. The bucket takes approx 5GB of disk space. It took just a few mins to load all the records. So far so good.
Then I created a secondary GSI index on one of the fields (to be able to select documents with property “ciid” equal to some value) with command
CREATE INDEX idx_ciid ON mtest(ciid)
The creation of the index took approx 4hours and consumed 135GB of space. Why the index build takes so long and why it consumed so much disk space? How can I avoid it or what did I do wrong? I’d expect to be much quicker and the disk space would be a lot less - the index is 27times larger than the primary data, how is that possible?
After a compation it dropped to 12GB which is still 2 times bigger than original data, however it’s manageable.
Can you help me and show me some direction, please?