We are using MongoDB kafka connector in an ec2 instance which runs in standalone mode and connects to AWS confluent instance.
When we try to create source connector which send data from collection to kafka topic in AWS it throws ‘Caused by: org.apache.kafka.common.errors.RecordTooLargeException: The message is 1066826 bytes when serialized which is larger than 1048576, which is the value of the max.request.size configuration.’ Exception.
We have already configured the max.message.bytes in kafka topic to 8388608 bytes but still facing the exception. Are we missing any config. I have read that we need to add max.request.size config with apporpriate value, in this scenario where can we make this change in AWS kafka ?