Managing Data Operating System
Also available as:
PDF
loading table of contents...

Prerequisites for using the device plug-in

Before you use the sample GPU/FPGA device plug-in in your framework or develop your own plug-in, you must ensure that you install the required software and enable a few configuration parameters.

  • Enable LinuxContainerExecutor on YARN to handle resource isolation and Docker.

    For information on enabling LinuxContainerExecutor, see Configure YARN for running Docker containers.

  • Install the required GPU drivers and Docker runtime on the nodes. For information about the required drivers, refer to the device documentation.
  • To use the YARN capacity scheduler, add the DominantResourceCalculator configuration in the capacity-scheduler.xml file.
    <property>
      <name>yarn.scheduler.capacity.resource-calculator</name>
    <value>org.apache.hadoop.yarn.util.resource.DominantResourceCalculator</value>
    </property>