I’m currently using elasticsearch and we index millions of records every weekend and perform aggregations on them.
Usually in our aggregation we would filter down on attribute 1 and attribute 2 and within a time range. Then we run an aggregation that puts the filtered items into buckets and aggregating those buckets by another attribute to put those into buckets. After all that we sum up the sales in those buckets in buckets. At this point elasticsearch is only returning the aggregations and have lost it’s other details in the document like name, item_code. The only way to get them back is by running another aggregation on the bucket in buckets that returns it’s details. After all this I have to parse through the data and match up the aggregations with the details and present them to the user.
Elasticsearch also has a query limit. It only returns 10000 items and doesn’t offer pagination on aggregations.
How does couchbase deal with all of this. I know that my use case sounds like the ravings of a lunatic so I apologize in advance.