A Kafka centric cluster is a cluster that has Kafka and Ranger deployed on it, but
does not have HDFS. You can install a Kafka centric cluster by provisioning the correct services
and by disabling long term audit logging in Ranger.
Starting with Cloudera Runtime 7.1.6, long term auditing in Ranger can be enabled or
disabled. If you do not need to store audit logs for more than 90 days, long term audit
logging can be disabled. If this feature is disabled, Ranger does not require HDFS as a
dependency. As a result, you can install and deploy a Kafka centric cluster, which has Kafka
and Ranger, but not HDFS
The following list of steps walk you through how you can set up a Kafka centric cluster.
These instructions act as an extension to the CDP Private Cloud Base Installation
Guide. Specifically, these steps provide a use case specific walkthrough of the
Add Cluster - Configuration wizard. They are intended as an
alternative to the instructions provided in Product Installation - Step 7: Set Up a
Cluster Using the Wizard.
Cloudera Manager is installed and running on your cluster.
Kerberos is set up and configured for your cluster.
You are logged into the Cloudera Manager Admin Console and have completed the
configuration and setup steps provided by the Add Cluster -
Installation wizard.
You are ready to install and configure services with the Add Cluster -
Configuration wizard.
If not started, start the Add Cluster - Configuration
wizard.
To start the wizard, click
Clusters > Add
Services.
The Select Services page is
displayed.
Select Services:
The Select Services page allows you to select the
services you want to install and configure.
Select the Custom Services option.
Scroll through the list and select the following services:
Core Configuration
Zookeeper
Kafka
Solr
Ranger
Click Continue.
The Assign Roles
page is displayed.
Assign Roles:
The Assign Roles page allows you to configure role
assignments for the hosts in your cluster. The page appears with suggested role
assignments for some services. However, the Kafka Broker role and certain other optional
roles must be configured manually.
Click the Select hosts field below Kafka
Broker.
Select 1 or more hosts from the list.
The Kafka Broker role is
assigned to the hosts that you select.
Click Ok.
Optional: Select hosts for other optional roles available on
this page.
Select hosts the same way as you did for the Kafka Broker
role.
Click Continue.
The Setup Database
page is displayed.
Setup Database:
On the Setup Database page, you can enter the database hosts, names, usernames, and passwords
you created when you installed and configured the databases on your hosts. Database setup
is required for the Ranger service and the Reports Manager role.
Select the database type and enter the database name, username, and password
for Ranger.
Ensure that No is selected from the
Use JDBC URL Override drop-down list.
Select the database type and enter the database name, username, and password
for Reports Manager.
Skip this step if the configuration fields for
Reports Manager are not displayed.
Click Test Connection to validate the settings.
After verifying that connection is successful, click
Continue.
The Enter Required Parameters
page is displayed.
Enter Required Parameters:
Ranger requires that you set initial
passwords for a number of its users.
Set a password for each user by configuring the properties displayed on this
page.
Click Continue.
The Review Changes
page is displayed.
Review Changes:
The Review Changes page lists default and suggested
settings for several configuration parameters. In addition, it allows you to configure
your services before starting them for the first time.
Find and configure the following properties:
Ranger Plugin DFS Audit Enabled: Clear the checkbox to
disable the feature.
Solr Secure Authentication: Select the
kerberos option.
Enable Kerberos Authentication: Select the checkbox to
enable Kerberos authentication.
Review and configure other properties available on this
page.
Click Continue.
Wait for the First Run Command to complete and click
Continue.
The Summary page is displayed with a
success or failure report of the setup wizard.
Click Finish to complete the cluster setup.
Complete additional installation steps required for Ranger available in Additional
Steps for Apache Ranger.
Review and complete post-installation actions available in After You
Install.