2.4.6. Rolling Restarts

When you restart multiple services, components, or hosts, use rolling restarts to distribute the task; minimizing cluster downtime and service disruption. A rolling restart stops, then starts multiple, running slave components such as DataNodes, TaskTrackers, NodeManagers, RegionServers, or Supervisors, using a batch sequence. You set rolling restart parameter values to control the number of, time between, tolerance for failures, and limits for restarts of many components across large clusters.

To run a rolling restart:

  1. Select a Service, then link to a lists of specific components or hosts that Require Restart.

  2. Select Restart, then choose a slave component option.

  3. Review and set values for Rolling Restart Parameters.

  4. Optionally, reset the flag to only restart components with changed configurations.

  5. Choose Trigger Restart.

Use Background Operations to monitor progress of rolling restarts.

 2.4.6.1. Setting Rolling Restart Parameters

When you choose to restart slave components, use parameters to control how restarts of components roll. Parameter values based on ten percent of the total number of components in your cluster are set as default values. For example, default settings for a rolling restart of components in a 3-node cluster restarts 1 component at a time, waits 2 minutes between restarts, will proceed if only one failure occurs, and restarts all existing components that run this service.

If you trigger a rolling restart of components, Restart components with stale configs defaults to true. If you trigger a rolling restart of services, Restart services with stale configs defaults to false.

Rolling restart parameter values must satisfy the following criteria:

 

Table 2.6. Validation Rules for Rolling Restart Parameters

ParameterRequiredValueDescription
Batch SizeYesMust be an integer > 0Number of components to include in each restart batch.
Wait TimeYesMust be an integer > = 0Time (in seconds) to wait between queuing each batch of components.
Tolerate up to x failuresYesMust be an integer > = 0Total number of restart failures to tolerate, across all batches, before halting the restarts and not queuing batches.

 2.4.6.2. Aborting a Rolling Restart

To abort future restart operations in the batch, choose Abort Rolling Restart.


loading table of contents...