I am doing lots of small appends to Couchbase documents (binary) until they don’t reach the size of about 50Kb and then I start a new document. Reaching the 50Kb takes about 5000 appends to the given document.
Looking at the usage stats, as the document is growing and getting closer to 50Kb the replication between the Couchbase nodes start taking up more and more bandwidth and when the process rolls over the document and starts writing into a new document and appending to that then the bandwidth usage drops and starts creeping up again as the document’s size grows.
This tells me that at each append the whole document is being replicated across the nodes (that seems the be the only explanation why the same append takes up more and more bandwidth as the document size grows).
This sounds like a bad design - making appends operations very non-optimal (having the whole document replicated at each append).
Would be my understanding incorrect? Any way to get around this, to make this more efficient?