We are having jobs that use the mongo spark connector: https://mvnrepository.com/artifact/org.mongodb.spark/mongo-spark-connector_2.12/3.0.0
A month ago we set the connector to run with a specific driver 4.0.5. After few days of successful runnings, the jobs fail, and the only way that the process succeeded to run is to upgrade to a new driver version: 4.2.0.
Again, after few days of successful running, the process that configures the same with 3.0.0 connector and driver 4.2.0 fail and the only solution that succeeded is upgrading to a newer driver version 4.2.2.
Eventually, it seems that if a new version of a driver came up, so an existing older version fails and we can’t figure out why?
If that case is common to more users?
That is the last configuration that is stable so far, but we can’t be sure it won’t fail once a newer driver version will be launched.
Can you please assist?