I apologize if this question has already been asked (on another note, the search functionality on this forum isn’t very good).
I understand that source filtering is not yet available. Though, how can I filter particular docID’s - I only want to import particular docID’s into elastic.
Thanks!
I think I found a lead:
couchbase.keyFilter
Could someone please show me an example of how to use this to filter for docID’s that start with: “user::”
Thank you!
Hi, you will find more details on this github issue: https://github.com/couchbaselabs/elasticsearch-transport-couchbase/issues/61
You should also try Couchbase 4.0 beta that provides some XDCR filtering by default.
anil
June 23, 2015, 4:51pm
4
Just a FYI, XDCR filtering in 4.0 Beta is available only for remote Couchbase cluster and not ElasticSearch cluster.
@ldoguin I think I might be doing something very wrong:
this is the relevant part of my ES config:
##couchbase
couchbase.password: <password>
couchbase.username: <username>
couchbase.maxConcurrentRequests: 1024
couchbase.defaultDocumentType: couchbaseDoc
couchbase.keyFilterType: include
couchbase.keyFilters.filter1: ^user.*$
In spite of the keyfilter I see all my documents coming into es. Is there anything I’m missing?
All our user documents have ID’s starting with user::. E.g. ‘user::79801’
Hi, were you able to find a solution to this? I have the exact same problem and there is no solution on the internet, or anywhere.