How to measure kafka reBalance duration
is there tool available to measure Kafka re-balancing duration? or check any intermediate status?
we have observe a many time, specific consumer get stuck forever during Kafka rebalancing, we never waited to finish.
Solution 1:
There was a bug in Apache Kafka 2.4.1
which got fixed, and MSK has 2.4.1.1. This was exactly related to infinite rebalance of consumers.
If your MSK running later versions, you can open support case.