I have a requirement to only keep data in Couchbase for a limited amount of time however we want to retain the data for historical reporting. Our documents in Couchbase will have an TTL of approx a few days. My first thought was to use XDCR and replicate the data into ElasticSearch however it looks like the expiration of documents will replicate down to ElasticSearch and that is a problem.
Any suggestions for easy ways to get data from Couchbase to another data store and not propagate deletes/document expiration? Ideally I need to have a process that is fairly real time (10-15 mins of lag would be ok).
Thanks for any ideas.