GPU node labeling on ECS

You can use NVIDIA Feature Discovery to generate labels for the set of GPUs available on ECS nodes. You can use these node labels to assign workloads to specific GPU devices. This feature is enabled by default on ECS.

Using GPU node labeling on ECS

Information about using GPU node labeling is available on the NVIDIA GPU feature discovery page.

Known Issues and Limitations

  • GPU node labeling is only supported for GPU cards manufactured by NVIDIA.
  • If an ECS node has multiple GPUs, not all of the GPUs will be labeled. The last GPU as per lspci will be labeled.
  • If an ECS node is provisioned from a provisioner with virtual GPUs (AWS, Azure, etc.) the nodes will not be labeled with the GPU information.