Cloudera Docs

Using Cloudera Manager Safety Valves to configure scheduler properties

Certain scheduler properties can neither be converted by the fs2cs conversion utility nor be configured using the YARN Queue Manager UI service. After migrating to CDP, you must manually configure these properties using the Cloudera Manager advanced configuration snippet (Safety Valves).

  • Use the fs2cs conversion utility to generate the capacity-scheduler.xml and yarn-site.xml output files.

  • Complete the scheduler migration process.

  • Identify the scheduler properties that need to be configured manually and not supported by the Queue Manager UI. For more information, see Fair Scheduler features and conversion details.

  1. In Cloudera Manager, select the YARN service.
  2. Click the Configuration tab.
  3. Search for capacity-scheduler, and find the Capacity Scheduler Configuration Advanced Configuration Snippet (Safety Valve).
  4. Click View as XML, and insert the complete capacity-scheduler.xml file, generated by the converter tool.
  5. Add the necessary configuration properties.
  6. Click Save Changes.
  7. Search for yarn-site, and find the YARN Service Advanced Configuration Snippet (Safety Valve) for yarn-site.xml.
  8. Click View as XML and add the required configuration in an XML format.
    Optionally, use + and - to add and remove properties.
  9. Click Save Changes.
  10. Restart the YARN service.