On local mode with local Couchbase, the Spark Streaming works just fine with the following configurations:
-Dcom.couchbase.bucket.beer-sample=""
-Dcom.couchbase.nodes=couchbase.my.domain:8091
-Dcom.couchbase.connectTimeout=100000
On the YARN cluster, the receivers try to connect to the default bucket:
16/07/07 13:28:37 INFO streaming.CouchbaseReceiver: Starting Couchbase (DCP) Stream against Bucket default
What is the problem here? The configuration should be read from SparkConf by the Spark Streaming client API as I’ve read from the internals.
Thanks!