This is an IBM Automation portal for Cloud Management, Technology Cost Management, Network Automation and AIOps products. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).
We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:
Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,
Post an idea.
Get feedback from the IBM team and other customers to refine your idea.
Follow the idea through the IBM Ideas process.
Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.
IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.
ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.
See this idea on ideas.ibm.com
Hello Team,
we are reaching out to request an enhancement to improve data retention capabilities during Instana backend infrastructure upgrades. Recently, during our self-host air-gapped environment Instana backend upgrade, we observed that all Instana agents stopped collecting data. Although data collection resumed after the upgrade, we experienced a data gap of approximately 20 to 25 minutes. We Open IBM support case, support team and IBM Technical Sales team have suggested to open enhancement request.
To prevent data loss during above scenarios, we propose the following enhancement options (option 1 or 2 or both):
Persistent Agent-Backend Connection During Upgrades: We suggest enhancing the Instana infrastructure to allow agents to maintain a persistent connection to the backend, even during upgrades. This would enable agents to continue collecting and transmitting data without interruption.
Agent-Level Caching Mechanism for Data Retention: As an alternative, we propose implementing a caching mechanism at the agent level. If an agent loses connection with the backend, it could temporarily cache data locally (for a configurable duration, such as 30 minutes). When the connection is restored, the agent would forward the cached data to the backend. This approach is similar to the IBM Tivoli Monitoring (ITM) agent's cache feature, which has proven effective in minimizing data loss during transient connection issues.
Business Value of This Enhancement
Data Continuity: Continuous data collection without interruption, even during maintenance windows, would prevent monitoring gaps.
Enhanced Reliability for Alerts and Analytics: Maintaining uninterrupted data flow improves the accuracy and reliability of alerts, trends, and analytical insights.
Improved Troubleshooting: Eliminating data gaps facilitates troubleshooting and allows for a more complete view of our environment’s health.
Implementation Considerations
To ensure a smooth experience, we recommend:
Allowing configurable settings for cache retention duration and size at the agent level to suit various infrastructure needs.
Ensuring a reliable synchronization mechanism for agents to send cached data once connection to the backend is re-established.
We believe that this enhancement would add significant value to the Instana platform and greatly enhance its reliability during upgrade processes. We kindly request that this feature be considered for future releases and are happy to provide any additional information or feedback needed.
Thank you and Best Regards
Idea priority | High |
By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.
Hello Khandker,
Thank you for taking the time to provide your ideas to IBM. We truly value our relationship with you and appreciate your willingness to share details about your experience, your recommendations, and ideas.
IBM has evaluated the request and has determined that it cannot be implemented at this time or does not align with our current strategy or roadmap.
In 12 months, you will receive a notification that you can resubmit this request for consideration.
Thank you for bringing your ideas to us. If you have any additional feedback, thoughts or ideas, or if there is anything else I can do, please do not hesitate to reply to this message to continue the conversation.
Best regards
Henning Treu - Product Manager Instana Agent