Kafka Cluster Consumer Group Metrics at the Partition Level

I would like to monitor Kafka consumer group metrics such as current offset, log end offset, lag, throughput, etc., at the partition level.

This would be similar to the metrics provided by the kafka-consumer-groups.sh CLI tool:

▶ bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --describe --group my-group

GROUP               TOPIC       PARTITION   CURRENT-OFFSET  LOG-END-OFFSET  LAG
my_consumer_group   my_topic    3           466552579140    466555101712    2522572
my_consumer_group   my_topic    2           465441201347    465443973791    2772444
my_consumer_group   my_topic    7           832170815467    832171950535    1135068
my_consumer_group   my_topic    0           467681966829    467684854884    2888055
my_consumer_group   my_topic    4           635344417235    635346807110    2389875
my_consumer_group   my_topic    5           608012034778    608016294905    4260127
my_consumer_group   my_topic    6           786214393587    786217043441    2649854
my_consumer_group   my_topic    1           466268145640    466270648921    2503281
my_consumer_group   my_topic    12          614493787790    614493794408    6618
...

This feature would be extremely helpful in identifying partition imbalances, such as when a single partition is receiving a disproportionate amount of data.