Cloudera Docs

Configuring Spark application logging properties

Minimum Required Role: Configurator (also provided by Cluster Administrator, Full Administrator)

To configure only the logging threshold level, follow the procedure in Configuring Logging Thresholds. To configure any other logging property, do the following:

  1. Open the cluster's Cloudera Manager URL.
  2. Go to the Spark service.
  3. Click the Configuration tab.
  4. Select Scope > Gateway.
  5. Select Category > Advanced.
  6. Locate the Gateway Logging Advanced Configuration Snippet (Safety Valve) for spark-conf/log4j.properties.
  7. Specify log4j properties. If more than one role group applies to this configuration, edit the value for the appropriate role group. See Modifying Configuration Properties Using Cloudera Manager.
  8. Enter a Reason for change, and then click Save Changes to commit the changes.
  9. Deploy the client configuration.