This is the documentation for Cloudera Manager 5.0.x. Documentation for other versions is available at Cloudera Documentation.

Cloudera Management Service

The Cloudera Management Service implements various management features as a set of roles:
  • Activity Monitor - collects information about activities run by the MapReduce service
  • Host Monitor - collects health and metric information about hosts
  • Service Monitor - collects health and metric information about services and activity information from the YARN and Impala services
  • Event Server - aggregates relevant Hadoop events and makes them available for alerting and searching
  • Alert Publisher - generates and delivers alerts for certain types of events
  • Reports Manager - generates reports that provide an historical view into disk utilization by user, user group, and directory, processing activities by user and YARN pool, and HBase tables and namespaces.
Cloudera Manager manages each role separately, instead of as part of the Cloudera Manager Server, for scalability (for example, on large deployments it's useful to put the monitor roles on their own hosts) and isolation.

In addition, for certain editions of the Cloudera Enterprise license, the Cloudera Management Service provides the Navigator Audit Server and Navigator Metadata Server (beta) roles for Cloudera Navigator.

Continue reading:

Displaying the Cloudera Management Service Status

  1. Do one of the following:
    • Select Clusters > Cloudera Management Service > mgmt.
    • On the Status tab of the Home page, in Cloudera Management Service table, click the mgmt link.

Starting the Cloudera Management Service

  1. Do one of the following:
      1. Select Clusters > Cloudera Management Service > mgmt.
      2. Select Actions > Start.
      1. On the Home page, click to the right of mgmt and select Start.
  2. Click Start to confirm. The Command Details window shows the progress of starting the roles.
  3. When Command completed with n/n successful subcommands appears, the task is complete. Click Close.

Stopping the Cloudera Management Service

  1. Do one of the following:
      1. Select Clusters > Cloudera Management Service > mgmt.
      2. Select Actions > Stop.
      1. On the Home page, click to the right of mgmt and select Stop.
  2. Click Stop to confirm. The Command Details window shows the progress of stopping the roles.
  3. When Command completed with n/n successful subcommands appears, the task is complete. Click Close.

Restarting the Cloudera Management Service

  1. Do one of the following:
      1. Select Clusters > Cloudera Management Service > mgmt.
      2. Select Actions > Restart.
      1. On the Home page, click to the right of mgmt and select Restart.
  2. Click Restart to confirm. The Command Details window shows the progress of stopping and then starting the roles.
  3. When Command completed with n/n successful subcommands appears, the task is complete. Click Close.

Configuring Management Service Database Limits

Each Cloudera Management Service role maintains a database for retaining the data it monitors. These databases (as well as the log files maintained by these services) can grow quite large. For example, the Activity Monitor maintains data at the service level, the activity level (MapReduce jobs and aggregate activities), and at the task attempt level. Limits on these data sets are configured when you create the management services, but you can modify these parameters through the Configuration settings in the Cloudera Manager Admin Console. For example, the Event Server lets you set a total number of events to store, and Activity Monitor gives you "purge" settings (also in hours) for the data it stores.

There are also settings for the logs that these various services create. You can throttle how big the logs are allowed to get and how many previous logs to retain.

  1. Do one of the following:
    • Select Clusters > Cloudera Management Service > mgmt.
    • On the Status tab of the Home page, in Cloudera Management Service table, click the mgmt link.
  2. Select Configuration > View and Edit.
  3. In the left-hand column, select the Default role group for the role whose configurations you want to modify.
  4. Edit the appropriate properties:
    • Activity Monitor - the Purge or Expiration period properties are found in the top-level settings for the role.
    • Host and Service Monitor - see Data Storage for Monitoring Data.
    • Log Files - log file size settings will be under the Logs category under the role group.
  5. Click Save Changes.

Adding and Starting Cloudera Navigator Roles

  1. Do one of the following:
    • Select Clusters > Cloudera Management Service > mgmt.
    • On the Status tab of the Home page, in Cloudera Management Service table, click the mgmt link.
  2. Click the Instances tab and click the Add button. The Customize Role Assignments page displays.
  3. Customize the assignment of role instances to hosts. The wizard evaluates the hardware configurations of the hosts to determine the best hosts for each role. The wizard assigns all worker roles to the same set of hosts to which the HDFS DataNode role is assigned. These assignments are typically acceptable, but you can reassign services to hosts of your choosing, if desired.

    Click a field below a role to display a dialog containing a pageable list of hosts. If you click a field containing multiple hosts, you can also select All Hosts to assign the role to all hosts or Custom to display the pageable hosts dialog.

    The following shortcuts for specifying host names are supported:
    • Range of hostnames (without the domain portion)
      Range Definition Matching Hosts
      10.1.1.[1-4] 10.1.1.1, 10.1.1.2, 10.1.1.3, 10.1.1.4
      host[1-3].company.com host1.company.com, host2.company.com, host3.company.com
      host[07-10].company.com host07.company.com, host08.company.com, host09.company.com, host10.company.com
    • IP addresses
    • Rack name

    Click the View By Host button for an overview of the role assignment by host ranges.

  4. When you are satisfied with the assignments, click Continue. The Database Setup page displays.
  5. Configure settings for required databases:
    1. Choose the database type:
      • Leave the default setting of Use Embedded Database to have Cloudera Manager create and configure all required databases. Make a note of the auto-generated passwords.
      • Select Use Custom Databases to specify external databases. Enter the database host, database type, database name, username, and password for the databases that you created when you set up databases for Cloudera Manager.
        1. Provide information for the Activity Monitor (only needed when using MapReduce), Reports Manager, and Hive Metastore, and Cloudera Navigator databases. The value you enter as the database hostname must match the value you entered for the hostname (if any) when you created the database.
    2. Click Test Connection to confirm that Cloudera Manager can communicate with the databases using the information you have supplied. If the test succeeds in all cases, click Continue; otherwise check and correct the information you have provided for the databases and then try the test again. (For Hive, if you are using the embedded database, you will see a message saying the database will be created at a later point in the installation process.) The Review Changes page displays.
  6. Review and accept any configuration changes (typically there are none). Click Accept. This returns you to the Instances page.
  7. Check the checkboxes next to navigator and navigatormetaserver (Flex Edition or Data Hub Edition only) .
  8. Select Actions for Selected > Start and confirm Start in the pop-up.
  9. Click Close.
Page generated September 3, 2015.