Cloudera Docs

Non-transparent proxy support on Cloudera AI Inference service

Proxy support in Cloudera AI Inference service, available in Cloudera AI on premises 1.5.5 SP2 and higher releases, addresses the critical need for secure and compliant outbound traffic management within air-gapped or heavily restricted network environments. This feature ensures that all outbound network traffic originating from the Cloudera AI Inference service data plane is routed exclusively through the configured proxy.

Key benefits of non-transparent proxy (NTP) support

  • Enhanced security and compliance – Proxy support maintains strict network control by enforcing all outbound communication to pass through the proxy. This approach ensures adherence to internal security policies and mandates for air-gapped environments.

  • Seamless integration – Proxy settings configured in the Cloudera Management Console are automatically applied to new Cloudera AI Inference service instances and endpoints.

  • Dynamic updates – This feature enables updating proxy configurations without requiring full service redeployments, minimising operational disruption.

When the Cloudera AI Inference service is created, the proxy settings are automatically inherited from the Cloudera Management Console without any additional configuration.

Updating proxy configuration

If proxy settings are updated in the Cloudera Management Console after the Cloudera AI Inference service has been created, users can trigger a Refresh action in the Cloudera AI. This action efficiently propagates the updated proxy configuration to the running Cloudera AI Inference service, ensuring that all services quickly adopt the new settings.