Large scale query with multi -threading and batch streaming

query
n1ql

#1

I’m trying to set up a batch process that runs a query to retrieve all the documents in the db that are marked to be deleted, and to delete them with a batch or streaming process. I have been told to use multi-threading, and having read the couchbase docs it seems asynchronous multi-threading is the best option. My question is, is it enough to use Observable with batch effects such as .async to make the most of the batch process, or do I have to implement multithreading apart from this asynchronous streaming process?


#2

Hi Boris,

As long as the way you process the query results is also asynchronous, multithreading probably won’t improve performance, since all Couchbase requests are routed through the same asynchronous core infrastructure anyway.

Thanks,
David