Skip to Main Content
Cloud Management and AIOps


This is an IBM Automation portal for Cloud Management and AIOps products. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).

Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:

Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,

Post your ideas
  1. Post an idea.

  2. Get feedback from the IBM team and other customers to refine your idea.

  3. Follow the idea through the IBM Ideas process.

Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

Status Submitted
Workspace Instana
Categories Sensor
Created by Guest
Created on May 15, 2024

Kafka Cluster Consumer Group Metrics at the Partition Level

I would like to monitor Kafka consumer group metrics such as current offset, log end offset, lag, throughput, etc., at the partition level.

This would be similar to the metrics provided by the kafka-consumer-groups.sh CLI tool:

▶ bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --describe --group my-group

 

GROUP               TOPIC       PARTITION   CURRENT-OFFSET  LOG-END-OFFSET  LAG
my_consumer_group   my_topic    3           466552579140    466555101712    2522572
my_consumer_group   my_topic    2           465441201347    465443973791    2772444
my_consumer_group   my_topic    7           832170815467    832171950535    1135068
my_consumer_group   my_topic    0           467681966829    467684854884    2888055
my_consumer_group   my_topic    4           635344417235    635346807110    2389875
my_consumer_group   my_topic    5           608012034778    608016294905    4260127
my_consumer_group   my_topic    6           786214393587    786217043441    2649854
my_consumer_group   my_topic    1           466268145640    466270648921    2503281
my_consumer_group   my_topic    12          614493787790    614493794408    6618
...


This feature would be extremely helpful in identifying partition imbalances, such as when a single partition is receiving a disproportionate amount of data.

Idea priority High