Converting Fair Scheduler to Capacity Scheduler using the fs2cs conversion utility
You can use the fs2cs conversion utility to automatically convert certain Fair Scheduler configuration to Capacity Scheduler configuration.
From the CDP Private Cloud Base 7.1 release, Cloudera provides
a conversion tool, called fs2cs conversion utility. This utility is a CLI
application that is part of the yarn CLI command. It generates
capacity-scheduler.xml
and yarn-site.xml
as
output files.
From CDP Private Cloud Base 7.1.6, the fs2cs conversion utility
converts the scheduler configuration from weight resource allocation mode in Fair
Scheduler to weight resource allocation mode in Capacity Scheduler. However, this
can be changed by using the -pc
command line option. If
-pc
is used, the fs2cs conversion utility converts from weight
resource allocation mode to relative (percentage) mode.
When using the fs2cs utility to automatically convert your Fair Scheduler into a Capacity Scheduler, you have to perform the following steps:
- Be aware of the Fair Scheduler properties that are auto-converted, those that require manual configuration, and those that do not have an equivalent feature in Capacity Scheduler. To learn about how properties are converted, see Plan your scheduler migration.
- You must have downloaded and distributed parcels for the target version of CDP.
yarn-site.xml
and the fair-scheduler.xml
configuration file. After the migration is completed, manually tune the configuration generated by the fs2cs conversion utility using Queue Manager UI and Cloudera Manager Advanced configuration snippet (Safety Valves).