Investigating consumer lag without guesswork

Hi everyone, we’ve created a new project called Broka that supports Kafka, RabbitMQ, Redis, ActiveMQ Artemis, and Memcached. If you don't mind, I’d love to walk you through it with a quick guide.

You can also check it out at broka.dev — would love to hear your thoughts and feedback!

---

Let me start introduction <3

A Kafka consumer group shows a lag of 0. Is it caught up?

Not necessarily. Offset lag only counts the partitions a group has committed to. A brand-new group that has never committed anything reports the same 0 as a group that is perfectly caught up.

The state beside the number is what tells them apart:

– Stable: members hold assignments. The lag is a backlog somebody is working on. – Empty: nobody is consuming. The lag will not move until a consumer joins, however small it is. – Rebalancing: the number describes an assignment that is changing under it.

https://broka.dev/guides/consumer-lag-without-guesswork

Thanks for your time