Is there any way the offsets can be committed for S3 sink connector as soon as the file is uploaded? Currently, it waits for the next schedule according to the offset commit interval specified for the worker.
can you use the connector overrides to change the offset commit interval for the S3 sink connector, such that it writes at a more preferred interval without affecting other connectors on the cluster? https://docs.confluent.io/platform/current/connect/references/allconfigs.html#override-the-worker-configuration
This sounds great. I will try this.
