To use cgroups, you must enable cgroup-based resource management under the host
resource management configuration properties. However, if you configure static service pools,
this property is set as part of that process.
Minimum Required Role:
Cluster
Administrator (also provided by Full
Administrator) This feature is not available when using Cloudera
Manager to manage Data Hub clusters.
Cgroups-based resource management can be enabled for all
hosts, or on a per-host basis.
-
If you have upgraded from a version of Cloudera Manager older than Cloudera Manager
4.5, restart every Cloudera Manager Agent before using cgroups-based resource
management:
- Stop all services, including the Cloudera Management
Service.
- On each cluster host, run as root:
- Start all services.
- Click the Hosts tab.
- Optionally click the link of the host where you want to enable
cgroups.
- Select .
- Select Enable Cgroup-based Resource Management.
- Restart all roles on the host or hosts.
Limitations
- Role group and role instance override cgroup-based resource management parameters
must be saved one at a time. Otherwise some of the changes that should be reflected
dynamically will be ignored.
- The role group abstraction is an imperfect fit for resource management parameters,
where the goal is often to take a numeric value for a host resource and distribute
it amongst running roles. The role group represents a "horizontal" slice: the same
role across a set of hosts. However, the cluster is often viewed in terms of
"vertical" slices, each being a combination of worker roles (such as TaskTracker,
DataNode, RegionServer, Impala Daemon, and so on). Nothing in Cloudera Manager
guarantees that these disparate horizontal slices are "aligned" (meaning, that the
role assignment is identical across hosts). If they are unaligned, some of the role
group values will be incorrect on unaligned hosts. For example a host whose role
groups have been configured with memory limits but that's missing a role will
probably have unassigned memory.