Cloudera Docs

Configuring Spark application logging properties

Minimum Required Role: Configurator (also provided by Cluster Administrator, Full Administrator)

To configure only the logging threshold level, follow the procedure in Configuring Logging Thresholds. To configure any other logging property, do the following:

  1. In the Cloudera Data Platform (CDP) Management Console, go to Data Hub Clusters.
  2. Find and select the cluster you want to configure.
  3. Click the link for the Cloudera Manager URL.
  4. Go to the Spark service.
  5. Click the Configuration tab.
  6. Select Scope > Gateway.
  7. Select Category > Advanced.
  8. Locate the Spark Client Advanced Configuration Snippet (Safety Valve) for spark-conf/log4j.properties property.
  9. Specify log4j properties. If more than one role group applies to this configuration, edit the value for the appropriate role group. See Modifying Configuration Properties Using Cloudera Manager.
  10. Enter a Reason for change, and then click Save Changes to commit the changes.
  11. Deploy the client configuration.