Python Kafka reset consumergroup offset example
This is a simple example of how to reset consumergroup offset for a given topic without creating new unique consumergroup names.
- Python 3.10
We will use spotify/kafka for quickly spinning up a kafka broker on localhost:9092. We now have two main Python scripts. A producer that will produce 10 new messages on the same topic with a random UUID as payload and a consumer with auto_commit disabled, that will always reset the offset for a given topic when started.
How to run
# 1) Spin up spotify/kafka on localhost:9092 docker compose up # 2) Start consumer (this will run indefinitely) pipenv run consume # 3) Start producer to produce 10 messages pipenv run produce # 4) Kill consumer and restart pipenv run consume # 5) Optionally produce more messages to test to your own satisfaction