Benefits of OTel Impala Integration
Learn about the benefits of integrating OpenTelemetry (OTel) with Impala focusing on enhanced observability, telemetry data insights, and optimized performance.
Enhanced query lifecycle and historical data
Integrating OTel with Impala provides enhanced observability through comprehensive data
collection. The following data is collected:
- Live query data – Data about important events in the lifecycle of actively running queries is sent to collectors in near real-time as the events happen.
- Historical query data – Data about completed queries can be retained by the destination OTel trace management system.
Performance and scalability impact
The integration is designed to have negligible impact on Impala's performance and is built for
scalability. The following performance and scalability impacts are valid for the integration:
- The performance impact on Impala is negligible because the system already collects all the necessary event and metric data.
- The process of sending data to the OTel endpoint is handled out-of-band in a separate thread, limiting any performance impact to just the sending of this data.
- Scalability concerns are primarily limited to the OTel Collector endpoint. Impala does not encounter scalability issues as long as communication with the Collector happens without delay.
