Cluster ManagementPDF version

Configuring spark-port-forwarder ports

The CDH/HDP cluster must have access to the Spark driver that runs on Cloudera Data Science Workbench hosts, on a set of randomized ports in the range, 20050-32767. You can customize this range to restrict the number of reserved ports.

  1. Log in to the Cloudera Manager Admin Console.
  2. On the Home > Status tab, click CDSW.
  3. Click the Configuration tab.
  4. Scroll to the Minimum port configured for the spark-port-forwarder field and enter the minimum port number you want to reserve.
    The default minimum port numer is 20050. You cannot specify a port lower than this number.
  5. In the Maximum port configured for the spark-port-forwarder field, enter the maximum port number you want to reserve.
    The maximum port number cannot be lower than the minimum port number. You must reserve a minimum of 100 ports for use. The maximum port number allowed is 32767.