Set source connector NOT to listen to some specific collection

Hi everyone,
we have just deployed our first Kafka Source connecter which is configured to listen to all database change events.
I have noticed that at least 50% of changes are coming from one specific collection which I would not want to listen to. Is there a way to specifically configure the connector to listen to all database, excluding this one collection?

You can define a regex expression within the pipeline parameter to fine tune the collections you’d like to include/exclude:

https://docs.mongodb.com/kafka-connector/v1.3/kafka-source/#multiple-source-example

To exclude, use a negative lookhead in your regex, something like
pipeline=[{"$match": {“ns.coll”: {"regex": ^((?!name_of_collection_to_skip).*) }}}]

2 Likes

This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.