we would like to export our data from Couchbase to a Relational DB in order to analyze them and create some reports.
My idea was to use the Spark Connector Java API to:
- Load the RDBS db with a N1QL query extracting data from the Couchbase db.
- Exploit the Couchbase Spark Connector Spark Streaming functionalities to propagate data changes from the couchbase database to the relational DB.
I would like to know if my approach is correct.
In addition looking at http://developer.couchbase.com/documentation/server/4.0/connectors/spark-1.0/java-api.html
I have noticed that an example regarding streaming functionalities is missing.
Is it possible to use spark connector streaming from Java? does it exist any example?
I have tried to write some code but withouth any documentation I have not been able to achieve my goal. In particular I have not been able to build the CouchbaseInputDStream correctly because I am not able to provide to the constructor the streamFrom and streamTo parameter. In addition I have not idea ho to retrieve changed couchbase documents from notifications.
Many thanks for the attention.