Cloudera Data Catalog for Cloudera on Premises
Cloudera Data Catalog is a service within Cloudera Data Services on premises that enables you to understand, manage, secure, and govern data assets across the enterprise. Cloudera Data Catalog helps you understand the data in your Data Lake, which is your Cloudera Base on premises cluster. You can search for relevant data, understand how data is created, modified, and used, and see how access to it is secured and protected.
Get started
- Check the cluster requirements for the Cloudera Base on premises cluster, whose Apache Atlas and Apache Ranger services provide the metadata and security policies that Cloudera Data Catalog uses.
- Check the prerequisites to learn which roles you need to use Cloudera Data Catalog and to launch profilers.
- Provide role access by assigning the EnvironmentAdmin or EnvironmentUser role for an environment.
- Launch profilers to start collecting metadata about your data assets. Cloudera Data Catalog launches the Kubernetes-based Compute Cluster automatically when you start the profilers.
Profile your data
Profilers create metadata annotations that summarize the content and shape of your data assets. Cloudera Data Catalog provides three types of profilers. Their names depend on your Cloudera Data Catalog version:
- Sensitive data detection: The Data Compliance Profiler in 1.5.5 SP2 and later and the Cluster Sensitivity Profiler in 1.5.5 SP1 and earlier inspect the context and content of your data to detect sensitive data and suggest classifications or tags.
- Column statistics: The Statistics Collector Profiler and the Hive Column Profiler show the shape and distribution of columnar data in Hive tables.
- Access activity: The Activity Profiler and the Ranger Audit Profiler show who accessed which data, visualize access patterns, and help you identify anomalies.
From 1.5.5 SP2, profilers use a containerized architecture that launches only the Kubernetes pods needed for the size of the database to profile. Delete launched profilers before you upgrade to 1.5.5 SP2, and relaunch them after the upgrade. Learn more about profilers in 1.5.5 SP2 and later and profilers in 1.5.5 SP1 and earlier.
Find and govern your data assets
Cloudera Data Catalog brings search, metadata, and governance tools together in one interface.
- Dashboard: See vital service information at a glance and use interactive cards to go straight to your datasets, bookmarks, and other content. Explore the Dashboard.
- Search: Select a Data Lake and search the names, types, descriptions, and other metadata of your assets. Start with an asset type, then narrow the results with filters specific to that type. Learn about search.
- Asset Details and lineage: Open an asset to view its properties, profiler results, classifications and glossary terms, upstream and downstream lineage, Atlas audits, and the Ranger policies and access audits that apply to it. View data asset details.
- Atlas tags: Create, modify, and delete Apache Atlas classifications as tags to improve data discovery and to support tag-based access control in Apache Ranger. Tags can propagate to related assets, and profilers can apply them automatically. Learn about Atlas tags.
What’s new
See What’s new in the release notes for the latest features and improvements. For known issues and fixed issues, see the release notes.
