Creating Data Hub cluster with Data Engineering cluster definition

You must create a Data Hub cluster with the "Data Engineering for AWS" cluster definition to obtain the Hive JDBC URL. You need the Hive JDBC URL while configuring the Spark job.

  1. Log into the CDP web interface.
  2. Navigate to Management Console > Environments, and select the environment where you would like to create a cluster.
  3. Click Create Data Hub.
  4. Select the Cluster Definition option.
  5. Select Data Engineering for AWS cluster definition from the Cluster Definition drop-down menu under Services.
    The list of services is automatically shown below the selected cluster definition name.
  6. Specify a name for your cluster and add any tags you might need.
  7. Click Provision Cluster.