Data Loading approach

As a part of working with a POC, we are thinking of a approach like extracting data from lotus notes ( as json files) and load the same into MongoDB staging collection and then to target collections. A question arised like … Is there any way to load the fine records ( proper w.r.t format of JSON and proper as per the mongodb utility expects) into the staging collection and discard the bad records.?

Appreciate any sort of help on this…

Best Regards
Kesav

Hi @ramgkliye,

How do you plan to load the records? Using a driver or mongoimport?

With a driver you can catch errors and continue. With a mongoimport you can use the --parseGrace

https://docs.mongodb.com/manual/reference/program/mongoimport/#cmdoption-mongoimport-parsegrace

Regards
Pavel