Enabling Resource Management with Control Groups
Enabling Linux Control Groups (cgroups) using Cloudera Manager.
Minimum Required Role: Cluster Administrator (also provided by Full Administrator)
Cgroups-based resource management can be enabled for all hosts, or on a per-host basis.- Click .
- Click .
- Select the Enable Cgroup-based Resource Management parameter.
- To enable Cgroups only on specific hosts:
- Restart all roles on the host(s).
- To configure the default Cloudera Manager resource parameters, see Configuring Resource Parameters. If you are using Custom Cgroups to allocate resources, you configure those resource parameters in the Linux environment.
- Role group and role instance override cgroup-based resource management parameters must be saved one at a time. Otherwise some of the changes that should be reflected dynamically will be ignored.
- The role group abstraction is an imperfect fit for resource management parameters, where the goal is often to take a numeric value for a host resource and distribute it amongst running roles. The role group represents a "horizontal" slice: the same role across a set of hosts. However, the cluster is often viewed in terms of "vertical" slices, each being a combination of worker roles (such as TaskTracker, DataNode, RegionServer, Impala Daemon, and so on). Nothing in Cloudera Manager guarantees that these disparate horizontal slices are "aligned" (meaning, that the role assignment is identical across hosts). If they are unaligned, some of the role group values will be incorrect on unaligned hosts. For example a host whose role groups have been configured with memory limits but that's missing a role will probably have unassigned memory.