Spark Connector (StreamingContext.couchbaseStream) leaves threads hanging

Spark Connector
,
1

Environment:

  • Spark 2.1.0 (local mode, 10 slots)
  • Connector 2.1.0
  • Java 8 (update 112)
  • Windows 10 Pro

I’ve attached 3 images of the 3 different threads which are being created until the system crashes.
The only part where CB is accessed, is the StreamingContext.couchbaseStream.

Help needed.

CB3.PNG3069×1435 394 KB
CB2.PNG1960×1325 212 KB
CB1.PNG2068×1366 191 KB

2

Thread-leak has been misidentified. It was due to an internal application bug, where multiple buckets have been opened. Not caused by the Spark Connector.