Prerequisites for using the device plug-in
Before you use the sample GPU/FPGA device plug-in in your framework or develop your own plug-in, you must ensure that you install the required software and enable a few configuration parameters.
- Enable LinuxContainerExecutor on YARN to handle resource isolation and Docker.
For information on enabling LinuxContainerExecutor, see Configure YARN for running Docker containers.
- Install the required GPU drivers and Docker runtime on the nodes. For information about the required drivers, refer to the device documentation.
- To use the YARN capacity scheduler, add the DominantResourceCalculator configuration in
the
capacity-scheduler.xml
file.<property> <name>yarn.scheduler.capacity.resource-calculator</name> <value>org.apache.hadoop.yarn.util.resource.DominantResourceCalculator</value> </property>