Hello everyone! While trying to rely on manual offset committing (setting auto.commit.enabled = false), we’re seeing an inconsistent behaviour where most of the time a few more offsets than expected are committed. The question is, is there any case in which despite auto commit being disabled, the consumer will still commit a position on it’s own?! Thanks!
Havent heard of this happening before
Are you committing the right offset?
Using some framework to handle the kafka consumer or using vanilla client yourself?
We’re just calling consumer.commitSync()
Looks like the right method. I would read this Javadoc carefully (especially the “Manual Offset Control” section): https://kafka.apache.org/10/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html
Havent touched the raw client in a few years as I usually have a framework handle this