Configuring OTel in Impala

Learn how you can enable OTel in Impala and configure certain properties that enable you to optimize the data collection.

  • You must ensure that you are on Cloudera Data Warehouse on premises 1.5.5 SP1 or higher version.
  1. Log in to the Cloudera web interface and navigate to the Cloudera Data Warehouse service.
    The Overview page is displayed.
  2. From the Overview page, click the Virtual Warehouses tab, identify the Impala Virtual Warehouse that you want to configure, and then click the icon and choose the Edit action from the list of actions.
  3. In the Virtual Warehouse Details page, go to Configurations > Impala Coordinator and then select the flagfile option from the Configuration files list.
  4. Click the Add Custom Configuration button and manually add the configurations as needed.
    1. Required: Add the --otel_trace_collector_url configuration key.
      Specifies the URL of the OpenTelemetry collector to which trace data will be exported. The endpoint must be a valid URL.
      --otel_collector_url= https://collector-endpoint
    2. Required: Add the --otel_trace_enabled configuration key. The default value is false.
      If set to true, OpenTelemetry traces will be generated and exported to the configured OpenTelemetry collector.
    3. Optional: Add the otel_trace_batch_max_batch_size configuration key. The default value is 512.
      Specifies the maximum batch size of every export to the OTel Collector. This configuration is applicable when the value of the otel_trace_span_processor configuration is batch.
    4. Optional: Add the otel_trace_batch_queue_size configuration key. The default value is 2048.
      Specifies the maximum buffer or queue size. After the set size is reached, spans are dropped. This configuration is applicable when the value of the otel_trace_span_processor configuration is batch.
    5. Optional: Add the otel_trace_batch_schedule_delay_ms configuration key. The default value is 5000.
      Specifies the delay interval in milliseconds between two consecutive batch exports. This configuration is applicable when the value of the otel_trace_span_processor is batch.
    6. Optional: Add the otel_trace_additional_headers configuration key.
      Specifies a list of additional HTTP headers to be sent with each call to the OTel Collector .
    7. Optional: Add the otel_trace_ca_cert_path configuration key.
      Specifies the path to a file containing a CA certificates bundle.
    8. Optional: Add the otel_trace_ca_cert_string configuration key.
      Specifies a string containing a CA certificates bundle.
    9. Optional: Add the otel_trace_compression configuration key. The default value is true.
      If set to true, uses ZLib compression for sending data to the OTel Collector.
    10. Optional: Add the otel_trace_timeout_s configuration key. The default value is 10.
      Specifies the export timeout in seconds.
    11. Optional: Add the otel_trace_tls_insecure_skip_verify configuration key. The default value is false.
      If set to true, skips verification of the collector TLS certificate.
    12. Optional: Add the otel_trace_tls_minimum_version configuration key. The default value is the overall minimum TLS version.
      Specifies the minimum allowed TLS version.
    13. Optional: Add the ssl_minimum_version configuration key. The default value is tlsv1.2.
      Specifies the minimum SSL or TLS version that Impala Thrift services are expected to use for both client and server connections. This flag applies to all Impala Thrift services, and supported versions include TLSv1, TLSv1.1, and TLSv1.2.
    14. Optional: Add the otel_trace_ssl_ciphers configuration key. The default value is the value of Impala ssl_cipher_list startup flag.
      Specifies a list of allowed TLS cipher suites when using TLS 1.2.
    15. Optional: Add the otel_trace_tls_cipher_suites configuration key. The default value is the value of Impala tls_ciphersuites startup flag.
      Specifies a list of allowed TLS cipher suites when using TLS 1.3.
    16. Optional: Add the otel_trace_retry_policy_max_attempts configuration key. The default value is 5.
      Specifies the maximum number of call attempts, including the original attempt.
    17. Optional: Add the otel_trace_retry_policy_initial_backoff_s configuration key. The default value is 1.
      Specifies the initial backoff delay between retry attempts in seconds.
    18. Optional: Add the otel_trace_retry_policy_max_backoff_s configuration key. The default value is 0.
      Specifies the maximum backoff delay between retry attempts in seconds. A value of 0 or less indicates that the configuration key is not set.
    19. Optional: Add the otel_trace_retry_policy_backoff_multiplier configuration key. The default value is 2.
      Specifies the factor by which the retry interval increases after every failed attempt.
    20. Optional: Add the otel_debug configuration key. The default value is false.
      If set to true, this outputs additional debug information.
  5. Click the Apply Changes button and restart the Impala Virtual Warehouse.