Homepage/Cloudera Base on premises7.0.3

(Private Cloud)

Search Documentation

▶︎Cloudera
1. Reference Architectures
▼Cloudera on cloud
▶︎Cloudera on premises
▶︎Cloudera Manager
1. Cloudera Manager
▶︎Applications
▶︎Legacy
▶︎

Getting Started
Patterns
Preview Features
Data Catalog
Data Engineering
DataFlow
Data Hub
Data Warehouse
Data Warehouse Runtime
Cloudera AI
Management Console
Operational Database
Replication Manager
DataFlow for Data Hub
Runtime

«

Filter topics

Cloudera Runtime
▶︎Cloudera Runtime Release Notes
Cloudera Manager Release Notes
▼Concepts
▶︎Planning
1. ▶︎Deployment Planning for Cloudera Search
  1. ▶︎Deployment Planning for Cloudera Search
2. ▶︎Planning for Apache Impala
  1. Guidelines for Schema Design
  2. User Account Requirements
▶︎How To
▶︎Troubleshooting
▶︎Reference

A List of S3A Configuration Properties
About HBase snapshots
About the Off-heap BucketCache
Access HDFS from the NFS Gateway
Access the YARN web user interface
Accessing Apache HBase
Accessing Avro data files from Spark SQL applications
Accessing Cloud Data
Accessing compressed files in Spark
Accessing data stored in Amazon S3 through Spark
Accessing external storage from Spark
Accessing HDFS Files from Spark
Accessing Hive from Spark
Accessing Hive tables from Spark in CDP Data Center
Accessing ORC Data in Hive Tables
Accessing ORC files from Spark
Accessing Parquet files from Spark SQL applications
Accessing Spark SQL through the Spark shell
Accessing the Oozie server with a browser
Accessing the Oozie server with the Oozie CLIent
Accessing the Ranger console
Accessing the Spark History Server
Accessing the tracing web interface
Accessing YARN logs
Accumulo
ACID operations
ACL examples
ACLS on HDFS features
Activate read replicas on a table
Activating the Hive Web UI
Add a custom coprocessor
Add a group
Add a user
Add a ZooKeeper service
Add HDFS system mount
Add HMS properties to hive-site.xml
Add or edit permissions
Add queues using YARN Queue Manager UI
Add storage directories using Cloudera Manager
Add the HttpFS role
Adding a custom banner
Adding a Hue role instance with Cloudera Manager
Adding a Hue service with Cloudera Manager
Adding a load balancer
Adding a Ranger security zone
Adding a tag-based PII policy
Adding a tag-based service
Adding and Removing Range Partitions
Adding attributes to classifications
Adding schema to Oozie using Cloudera Manager
Adding tag-based policies
Adding the Lily HBase Indexer Service
Adding the Oozie service using Cloudera Manager
Additional considerations when configuring TLS/SSL for Oozie HA
Additional HDFS haadmin commands to administer the cluster
Adjust the Solr replication factor for index files stored in HDFS
Administering Apache Kudu
Administering Hue
Administering Ranger Reports
Administering Ranger Users, Groups, Roles, and Permissions
Administrative commands
Admission Control and Query Queuing
Admission Control Sample Scenario
Advanced Committer Configuration
Advanced configuration for write-heavy workloads
Advanced erasure coding configuration
Advanced ORC properties
Advanced partitioning
Aggregate and group data
Aggregate functions
Aliases
Allocating DataNode memory as storage
Allocating Resources using YARN Queue Manager UI
Already present: FS layout already exists
ALTER DATABASE statement
ALTER MATERIALIZED VIEW REBUILD
ALTER MATERIALIZED VIEW REWRITE
ALTER TABLE statement
ALTER VIEW statement
Altering a table
Altering table properties
Analytic functions
Apache Atlas Advanced Search language reference
Apache Atlas metadata collection overview
Apache Atlas Reference
Apache Atlas Statistics reference
Apache Hadoop YARN Overview
Apache Hadoop YARN Reference
Apache HBase Overview
Apache Hive 3 architectural overview
Apache Hive 3 tables
Apache Hive content roadmap
Apache Hive key features
Apache Hive Materialized View Commands
Apache Hive Overview
Apache Hive Performance Tuning
Apache Hive query basics
Apache Hive-Kafka integration
Apache Impala Overview
Apache Impala Reference
Apache Impala SQL Reference
Apache Kafka Overview
Apache Kudu administration
Apache Kudu background maintenance tasks
Apache Kudu concepts and architecture
Apache Kudu Design
Apache Kudu Overview
Apache Kudu overview
Apache Kudu schema design
Apache Kudu transaction semantics
Apache Kudu usage limitations
Apache Phoenix Frequently Asked Questions
Apache Phoenix Overview
Apache Phoenix Performance Tuning
Apache Ranger Auditing
Apache Ranger Authorization
Apache Spark access to Apache Hive
Apache Spark Overview
Apache Spark Overview
APIs for accessing HDFS
Application ACL evaluation
Application development
Application Reservations
Applications and permissions reference
APPX_MEDIAN function
Architectural overview
ARRAY complex type
Assigning administrator privileges to users
Assigning superuser status to an LDAP user
Assigning terms to categories
Associate a table in a non-customized environment without Kerberos
Associate Node Labels with Queues
Associate table in a customized Kerberos environment
Associating classifications with entities
Associating Tables of a Schema to a Namespace
Associating terms with entities
Atlas
Atlas
Atlas dashboard tour
Atlas Metadata model overview
Audit Overview
Authenticating users with LDAP
Authenticating users with SAML
Authentication
Authentication tokens
Authorization
Authorize read access to tables from Spark
Authorizing Apache Hive Access
Authorizing user groups with Sentry
Auto-TLS Agent File Locations
Auto-TLS Requirements and Limitations
Automate partition discovery and repair
Automatic Invalidation of Metadata Cache
Automatic Invalidation/Refresh of Metadata
Automating Spark Jobs with Oozie Spark Action
AVG
AVG function
Back up HDFS metadata
Back up HDFS metadata using Cloudera Manager
Backing Up a Solr Collection
Backing Up and Restoring Cloudera Search
Backing Up and Restoring Solr Collections
Backing up HDFS metadata
Backing up NameNode metadata
Balancer commands
Balancing data across an HDFS cluster
Balancing data across disks of a DataNode
Basic partitioning
Basics
Batch Indexing
Batch Indexing into Offline Solr Shards
Batch Indexing into Online Solr Servers Using GoLive
Benefits of centralized cache management in HDFS
Best practices for building Apache Spark applications
Best Practices for Ordering Policies
Best practices for performance tuning
Best practices for rack and node setup for EC
Best practices when adding new tablet servers
Best practices when using RegionServer grouping
BIGINT data type
Bit functions
Block cache size
Block move execution
Block move scheduling
BOOLEAN data type
Bringing a tablet that has lost a majority of replicas back online
Broker garbage log collection and log rotation
Broker log management
Broker migration
Broker Tuning
Brokers
Browse HBase tables
BucketCache IO engine
Build the project and upload the JAR
Building and deploying UDFs
Building and running a Spark Streaming application
Building Cloudera Manager charts with Kafka metrics
Building reusable modules in Apache Spark applications
Building Spark Applications
Building the Java client
Built-in functions
Bypass the BlockCache
Cache eviction priorities
Caching terminology
Call the UDF in a query
Calling Hive user-defined functions (UDFs)
Canary test for pyspark command
Cancelling a Query
Catalog operations
Catalog table
CDS 3 (Experimental) Powered by Apache Spark
CDS 3 Overview
CDS 3 Packaging, and Download
CDS 3 Requirements
CDS 3.0 Maven Artifacts
Centralized cache management architecture
Changes after upgrading
Changing a nameservice name for Highly Available HDFS using Cloudera Manager
Changing directory configuration
Changing master hostnames
Changing the page logo
CHAR data type
CHAR data type support
Check Job History
Check Job Status
Check query execution
Choose the right import method
Choosing Data Formats
Choosing the number of partitions for a topic
Choosing Transformations to Minimize Shuffles
ClassNotFoundException: com.cloudera.kudu.hive.KuduStorageHandler
Cleaning up after failed jobs
CLI commands to perform snapshot operations
Client and broker compatibility across Kafka versions
Client authentication to secure Kudu clusters
Client authentication using delegation tokens
Client connections to HiveServer
Close HiveWarehouseSession operations
Cloud storage connectors overview
Cloudera Runtime
Cloudera Runtime Component Versions
Cloudera Runtime Release Notes
Cloudera Search Architecture
Cloudera Search Authentication
Cloudera Search Backup and Restore Command Reference
Cloudera Search Configuration and Log Files
Cloudera Search ETL
Cloudera Search Frequently Asked Questions
Cloudera Search Overview
Cloudera Search Overview
Cloudera Search Security
Cloudera Search Tasks and Processes
Cluster balancing algorithm
Cluster management limitations
Cluster Management with Capacity Scheduler
Cluster sizing
Coarse-grained authorization
Collecting metrics via HTTP
Column compression
Column design
Column encoding
Columnar datastore
Command Line Tools
Commands for configuring storage policies
Commands for managing buckets
Commands for managing keys
Commands for managing volumes
Commands for using cache pools and directives
COMMENT statement
Comments
Common Kudu workflows
Common replication topologies
Common web interface pages
Compacting on-disk data
Compaction prerequisites
Compactor properties
Compare queries
Comparing replication and erasure coding
Complex types
Components
Compose queries
Compound operators
Compute
COMPUTE STATS statement
Conditional functions
Config Templates
Configuration properties
Configuration updates for Spark to work with OzoneFS
Configurations and CLI options for the HDFS Balancer
Configure a resource-based policy: Atlas
Configure a resource-based policy: HBase
Configure a resource-based policy: HDFS
Configure a resource-based policy: Hive
Configure a resource-based policy: Kafka
Configure a resource-based policy: Knox
Configure a resource-based policy: NiFi
Configure a resource-based policy: NiFi Registry
Configure a resource-based policy: Solr
Configure a resource-based policy: YARN
Configure a resource-based service: Atlas
Configure a resource-based service: HBase
Configure a resource-based service: HDFS
Configure a resource-based service: Hive
Configure a resource-based service: Kafka
Configure a resource-based service: Knox
Configure a resource-based service: NiFi
Configure a resource-based service: NiFi Registry
Configure a resource-based service: Solr
Configure a resource-based service: YARN
Configure a Spark job for dynamic resource allocation
Configure acceptable Kerberos principal patterns
Configure access to managed tables from Spark
Configure archival storage
Configure Asynchronous Scheduler
Configure Atlas authentication for AD
Configure Atlas authentication for LDAP
Configure Atlas Authorization using Ranger
Configure Atlas file-based authentication
Configure BucketCache IO engine
Configure bulk load replication
Configure clients on a producer or consumer level
Configure clients on an application level
Configure CPU scheduling and isolation
Configure Cross-Origin Support on YARN
Configure DataNode memory as storage
Configure encryption in HBase
Configure four-letter-word commands in ZooKeeper
Configure GPU scheduling and isolation
Configure HBase for use with Phoenix
Configure HBase garbage collection
Configure HBase in Cloudera Manager to store snapshots in Amazon S3
Configure HBase servers to authenticate with a secure HDFS cluster
Configure HDFS RPC protection
Configure Intra-Queue Preemption
Configure Intra-Queue Preemption for a specific queue
Configure JMX ephemeral ports
Configure Kafka brokers
Configure Kafka clients
Configure Kerberos authentication for Apache Atlas
Configure Kerberos authentication for Apache Ranger
Configure Kerberos Authentication for Solr
Configure log aggregation
Configure memory settings
Configure metastore database properties
Configure metastore location and HTTP mode
Configure mountable HDFS
Configure node labels
Configure partitions for transactions
Configure Phoenix Query Server
Configure preemption for a specific queue
Configure Queue Mapping for Users and Groups to Queues with the Same Name
Configure queue mapping for users and groups to specific queues
Configure queue mapping to use the user name from the application tag using Cloudera Manager
Configure Queue Ordering Policies
Configure Queue Preemption
Configure Queue Properties
Configure Ranger authentication for AD
Configure Ranger authentication for LDAP
Configure Ranger authentication for PAM
Configure Ranger authentication for UNIX
Configure read replicas using Cloudera Manager
Configure RegionServer grouping
Configure S3 credentials for working with Ozone
Configure Scheduler Properties
Configure secure HBase replication
Configure secure HBase replication
Configure secure replication
Configure snapshots
Configure source and destination realms in krb5.conf
Configure storage balancing for DataNodes using Cloudera Manager
Configure storage-based authorization
Configure temporary table storage
Configure the blocksize for a column family
Configure the compaction speed using Cloudera Manager
Configure the dynamic resource pool used for exporting and importing snapshots in Amazon S3
Configure the G1GC garbage collector
Configure the graceful shutdown timeout property
Configure the HBase canary
Configure the HBase client TGT renewal period
Configure the HBase Thrift Server Role
Configure the NFS Gateway
Configure the off-heap BucketCache using Cloudera Manager
Configure the off-heap BucketCache using the command line
Configure the resource-based Ranger service used for authorization
Configure the scanner heartbeat using Cloudera Manager
Configure the storage policy for WALs using Cloudera Manager
Configure the storage policy for WALs using the Command Line
Configure TLS/SSL encryption for Solr
Configure TLS/SSL for Apache Atlas
Configure TLS/SSL for Apache Ranger
Configure TLS/SSL for core Hadoop services
Configure TLS/SSL for HBase REST Server
Configure TLS/SSL for HBase Thrift Server
Configure TLS/SSL for HBase Web UIs
Configure TLS/SSL for HDFS
Configure TLS/SSL for Oozie
Configure TLS/SSL for YARN
Configure Transparent Data Encryption for Ozone
Configure ulimit for HBase using Cloudera Manager
Configure ulimit for HBase using the command line
Configure ulimit using Pluggable Authentication Modules using the Command Line
Configure YARN for long-running applications
Configure YARN ResourceManager High Availability
Configure YARN Services using Cloudera Manager
Configure ZooKeeper client shell for Kerberos authentication
Configure ZooKeeper server for Kerberos authentication
Configuring a secure Kudu cluster using Cloudera Manager
Configuring a secure Kudu cluster using the command line
Configuring Access to S3
Configuring ACLs on HDFS
Configuring Advanced Security Options for Apache Ranger
Configuring an external database for Oozie
Configuring and running the HDFS balancer using Cloudera Manager
Configuring and Securing Atlas
Configuring and tuning S3A block upload
Configuring Apache Hadoop YARN High Availability
Configuring Apache Hadoop YARN Log Aggregation
Configuring Apache Hadoop YARN Security
Configuring Apache HBase
Configuring Apache HBase for use with Apache Phoenix
Configuring Apache HBase High Availability
Configuring Apache Hive
Configuring Apache Kafka
Configuring Apache Spark
Configuring Apache ZooKeeper
Configuring Atlas Authentication
Configuring Atlas Authorization
Configuring authentication for long-running Spark Streaming jobs
Configuring authentication with LDAP and direct bind
Configuring authentication with LDAP and search bind
Configuring Authorization
Configuring block size
Configuring Client Access to Impala
Configuring Cluster Capacity with Queues
Configuring coarse-grained authorization with ACLs
Configuring concurrent moves
Configuring Data Protection
Configuring Dedicated Coordinators and Executors
Configuring Delegation for Clients
Configuring Directories for Intermediate Data
Configuring dynamic resource allocation
Configuring Dynamic Resource Pool
Configuring Encryption for Specific Buckets
Configuring Event Based Automatic Metadata Sync
Configuring Fault Tolerance
Configuring for HDFS high availability
Configuring for Kudu Tables
Configuring group permissions
Configuring HBase BlockCache
Configuring HBase MultiWAL
Configuring HBase snapshots
Configuring HBase to use HDFS HA
Configuring HDFS ACLs
Configuring HDFS High Availability
Configuring HDFS trash
Configuring heterogeneous storage in HDFS
Configuring high availability
Configuring Hive and Impala for high availability with Hue
Configuring HiveServer high availability
Configuring HMS for high availability
Configuring HSTS for HDFS Web UIs
Configuring HTTPS encryption for the Kudu master and tablet server web UIs
Configuring Hue as a TLS/SSL client
Configuring Hue as a TLS/SSL server
Configuring HWC in CDP Data Center
Configuring Impala
Configuring Impala TLS/SSL
Configuring Impala to work with HDFS HA
Configuring Impala Web UI
Configuring impersonation (doas)
Configuring JDBC for Impala
Configuring Kerberos Authentication
Configuring LDAP Authentication
Configuring LDAP on unmanaged clusters
Configuring Lily HBase Indexer Security
Configuring Lily HBase Indexer Service to Use Kerberos Authentication
Configuring Load Balancer for Impala
Configuring log levels for command line tools
Configuring MariaDB for Oozie
Configuring MultiWAL support using Cloudera Manager
Configuring MySQL for Oozie
Configuring ODBC for Impala
Configuring Oozie
Configuring Oozie data purge settings using Cloudera Manager
Configuring Oozie High Availability using Cloudera Manager
Configuring Oozie Sqoop1 Action workflow JDBC drivers
Configuring oozie to use HDFS HA
Configuring Oozie to use HDFS HA
Configuring Oracle for Oozie
Configuring other CDP components to use HDFS HA
Configuring Ozone Security
Configuring Per-Bucket Settings
Configuring Per-Bucket Settings to Access Data Around the World
Configuring PostgreSQL for Oozie
Configuring Proxy Users to Access HDFS
Configuring query vectorization
Configuring quotas
Configuring Ranger Authentication with UNIX, LDAP, AD, or PAM
Configuring Ranger Authentication with UNIX, LDAP, or AD
Configuring Ranger Authorization for Atlas
Configuring resource-based policies
Configuring resource-based services
Configuring S3Guard
Configuring SAML authentication on managed clusters
Configuring Spark application logging properties
Configuring Spark application properties in spark-defaults.conf
Configuring Spark Applications
Configuring Spark on YARN Applications
Configuring storage balancing for DataNodes
Configuring the balancer threshold
Configuring the Hive Metastore to use HDFS HA
Configuring the storage policy for the Write-Ahead Log (WAL)
Configuring TLS/SSL for HBase
Configuring user authentication in a CDP Private Cloud Base deployment
Configuring user authentication using LDAP in a CDP Private Cloud Base deployment
Configuring user authentication using SPNEGO in a CDP Private Cloud Base deployment
Confirm the election status of a ZooKeeper service
Connect an external database
Connecting Hive to BI tools using a JDBC/ODBC driver
Connecting to Apache Phoenix Query Server
Connecting to Impala Daemon in Impala Shell
Considerations for backfill inserts
Considerations for Oozie to work with aws
Considerations for working with HDFS snapshots
Contents of the BlockCache
Control access to queues using ACLs
Control access to queues using ACLs
Controlling Data Access with Tags
Controlling data access with tags
Conversion functions
Convert an HDFS file to ORC
Converting from an NFS-mounted shared edits directory to Quorum-Based Storage
Converting Hive CLI scripts to Beeline
Converting Instance Directories to Configs
Copy Sample Tweets to HDFS
Copying data between a secure and an insecure cluster using DistCp and WebHDFS
Corruption: checksum error on CFile block
COUNT
COUNT function
Create a Collection for Tweets
Create a CRUD transactional table
Create a custom service
Create a Hadoop archive
Create a read-only Admin user (Auditor)
Create a snapshot policy
Create a Sqoop import command
Create a standard service
Create a table for a Kafka stream
Create a temporary table
Create a Test Collection
Create a time-bound policy
Create a topology map
Create a topology script
Create a user-defined function
Create an insert-only transactional table
Create and use a materialized view
Create and use a partitioned materialized view
CREATE DATABASE statement
Create empty table on the destination cluster
CREATE FUNCTION statement
CREATE MATERIALIZED VIEW
Create new services
Create partitions dynamically
Create snapshots on a directory
Create snapshots using Cloudera Manager
CREATE TABLE AS SELECT
CREATE TABLE statement
Create the UDF class
CREATE VIEW statement
Create, use, and drop an external table
Creating a Collection in Cloudera Search
Creating a Collection in Cloudera Search
Creating a Lily HBase Indexer Configuration File
Creating a Lily HBase Indexer Configuration File
Creating a Morphline Configuration File
Creating a Morphline Configuration File
Creating a new Kudu table from Impala
Creating a Solr Collection
Creating a table from an Amazon S3 file
Creating a truststore file in PEM format
Creating categories
Creating classifications
Creating glossaries
Creating labels
Creating Replicas of Existing Shards
Creating roles and granting permissions for Sentry
Creating Static Pools
Creating tables
Creating terms
CUME_DIST
Customize dynamic resource allocation settings
Customize the HDFS home directory
Customizing HDFS
Customizing Per-Bucket Secrets Held in Credential Files
Customizing the Hue web UI
Customizing time zones
DAS
DAS
DAS architecture
Data Access
Data Access
Data Analytics Studio Overview
Data Analytics Studio overview
Data compaction
Data Engineering
Data migration to Apache Hive
Data protection
Data Stewardship with Apache Atlas
Data storage metrics
Data types
Databases
DataNodes
DataNodes
Date and time functions
DATE data type
DDL statements
Debug Web UI for Catalog Server
Debug Web UI for Impala Daemon
Debug Web UI for StateStore
Decide to use the BucketCache
DECIMAL data type
Decimal type
Decommissioning or permanently removing a tablet server from a cluster
Dedicated Coordinator
Default EXPIRES ON tag policy
Define Queue Mapping Policies
Defining a Schema is Recommended for Production Use
Defining related terms
Delegation token based authentication
Delete a group
Delete a user
Delete data from a table
Delete HBase snapshots from Amazon S3
Delete Queues
Delete snapshots using Cloudera Manager
DELETE statement
Deleting a row
Deleting a Solr Collection
Deleting All Documents in a Solr Collection
Deleting in bulk
Deleting tables
Deletion
DENSE_RANK
Deploy HBase replication
Deploying and configuring Oozie Sqoop1 Action JDBC drivers
Deploying and Managing Services and Microservices on YARN
Deployment Planning for Cloudera Search
Deployment Planning for Cloudera Search
Describe a materialized view
DESCRIBE EXTENDED and DESCRIBE FORMATTED
DESCRIBE statement
Detecting slow DataNodes
Determine the table type
Developing and running an Apache Spark WordCount application
Developing Apache Kafka Applications
Developing Apache Spark Applications
Developing Applications with Apache Kudu
Developing applications with Apache Kudu
Diagnostics logging
Disable automatic compaction
Disable High Availability
Disable loading of coprocessors
Disable RegionServer grouping
Disable replication at the peer level
Disable the BoundedByteBufferPool
Disable work preserving recovery on ResourceManager
Disabling and redeploying HDFS HA
Disabling Oozie High Availability
Disabling S3Guard and destroying a table
Disk Balancer commands
Disk management
Disk Removal
Disk Replacement
Disk space usage
Disk space versus namespace
Distcp between secure clusters in different Kerberos realms
Distcp syntax and examples
DISTINCT operator
DML statements
DOUBLE data type
Downloading Hdfsfindtool from the CDH archives
Drop a materialized view
Drop an external table along with data
DROP DATABASE statement
DROP FUNCTION statement
DROP MATERIALIZED VIEW
DROP STATS statement
DROP TABLE statement
DROP VIEW statement
Dropping a Kudu table using Impala
Dumping the Oozie database
Dynamic allocation
Dynamic resource allocation properties
Dynamic Resource Pool Settings
Dynamic resource-based column masking in Hive with Ranger policies
Dynamic tag-based column masking in Hive with Ranger policies
Dynamically loading a custom filter
Edit a group
Edit a user
Edit or delete a snapshot policy
Editing rack assignments for hosts
Editing tables
Effects of WAL rolling on replication
Enable ACL for RegionServer grouping
Enable and disable snapshot creation using Cloudera Manager
Enable authorization for additional HDFS web UIs
Enable authorization for HDFS web UIs
Enable authorization in Kafka with Ranger
Enable automatic compaction
Enable bulk load replication using Cloudera Manager
Enable Cgroups
Enable debug-delay
Enable detection of slow DataNodes
Enable disk IO statistics
Enable Garbage Collector Logging
Enable GZipCodec as the default compression codec
Enable HBase high availability using Cloudera Manager
Enable HBase indexing
Enable hedged reads for HBase
Enable High Availability
Enable Kerberos Authentication in Cloudera Search
Enable LDAP Authentication in Solr
Enable multi-threaded faceting
Enable namespace mapping
Enable or disable authentication with delegation tokens
Enable override of default queue mappings
Enable Ranger Authorization in Cloudera Search
Enable RegionServer grouping using Cloudera Manager
Enable replication on a specific table
Enable SASL in HiveServer
Enable server-server mutual authentication
Enable snapshot creation on a directory
Enable the AdminServer
Enable TLS/SSL for HiveServer
Enable work preserving recovery on NodeManager
Enabling a multi-threaded environment for Hue
Enabling Admission Control
Enabling and disabling trash
Enabling as a TLS/SSL client
Enabling Cluster-wide HBase Replication
Enabling core dump for the Kudu service
Enabling fault-tolerant processing in Spark Streaming
Enabling HDFS HA
Enabling High Availability and automatic failover
Enabling Hue applications with Cloudera Manager
Enabling Hue as a TLS/SSL server using Cloudera Manager
Enabling Kerberos authentication and RPC encryption
Enabling Kerberos for authentication
Enabling LDAP Authentication for impala-shell
Enabling LDAP authentication with HiveServer2 and Impala
Enabling LDAP for in Hue
Enabling Native Acceleration For MLlib
Enabling Oozie High Availability
Enabling Oozie SLA with Cloudera Manager
Enabling or disabling anonymous usage date collection
Enabling Replication on HBase Column Families
Enabling Sentry in the security browser
Enabling Solr Clients to Authenticate with a Secure Solr
Enabling Spark authentication
Enabling Spark Encryption
Enabling Speculative Execution
Enabling SSE-C
Enabling SSE-KMS
Enabling SSE-S3
Enabling the Oozie web console on managed clusters
Enabling the SQL editor autocompleter
Enabling TLS/SSL communication with HiveServer2
Enabling TLS/SSL communication with Impala
Enabling vectorized query execution
Encrypting an S3 Bucket with Amazon S3 Default Encryption
Encrypting Communication
Encrypting Data on S3
Encryption
Encryption Reference
Environment variables for sizing NameNode heap memory
Erasure coding CLI command
Erasure coding examples
Erasure coding overview
Errors during hole punching test
Escape an illegal identifier
Essential metrics to monitor
ETL with Cloudera Morphlines
Example Morphline Usage
Example solrctl Usage
Example use cases
Example workload
Example: Configuration for work preserving recovery
Example: Killing an application in the "Production" queue
Example: Moving the application and viewing the log in the "Test" queue
Example: Running SparkPi on YARN
Examples
Examples FIFO and Fair Sharing Policies
Examples of accessing Amazon S3 data from Spark
Examples of controlling data access using classifications
Examples of creating and using UDFs
Examples of DistCp commands using the S3 protocol and hidden credentials
Examples of estimating NameNode heap memory
Examples of using the Amazon Web Services command-line interface for S3 Gateway
Execute the Disk Balancer plan
Exit statuses for the HDFS Balancer
EXPLAIN statement
Exploring using Lineage
Export a snapshot to another cluster
Export all resource-based policies for all services
Export Ranger reports
Export resource-based policies for a specific service
Export tag-based policies
Exporting query results to Amazon S3
Expose HBase metrics to a Ganglia server
Extending Atlas to Manage Metadata from Additional Sources
Extending Atlas to manage metadata from additional sources
External table access
Failures during INSERT, UPDATE, UPSERT, and DELETE operations
FAQ
FAQ
Fetching Spark Maven dependencies
File descriptor limits
File descriptors
Files and directories
Files and directories
Filesystems
Filter HMS results
Filter types
Finding issues
FIRST_VALUE
Fixing block inconsistencies
Fixing issues
FLOAT data type
Flushing data to disk
Format for using Hadoop archives with MapReduce
Functions
General Quota Syntax
Generate and view Apache Hive statistics
Generate surrogate keys
Generating statistics
Generating Table and Column Statistics
Getting the JDBC or ODBC driver
Glossaries overview
Governance
Governance
Governance Overview
Governance overview
Graceful HBase shutdown
Gracefully shut down an HBase RegionServer
Gracefully shut down the HBase service
GRANT statement
GROUP BY clause
Groups and fetching
GROUP_CONCAT function
Guidelines for Deploying Cloudera Search
Guidelines for Schema Design
Hadoop archive components
Hadoop File Formats Supports
Handling bucketed tables
Handling disk failures
Handling large messages
Hash and hash partitioning
Hash and range partitioning
Hash partitioning
Hash partitioning
HashTable/SyncTable tool configuration
HAVING clause
HBase
HBase
HBase actions that produce Atlas entities
HBase audit entries
HBase authentication
HBase authorization
HBase backup and disaster recovery strategies
HBase configuration to use S3 as a storage layer
HBase entities created in Atlas
HBase filtering
HBase I/O components
HBase is using more disk space than expected
Hbase lineage
HBase metadata collection
HBase Object Store Semantics overview
HBase on CDP
HBase online merge
HBase read replicas
HBase Shell example
HBase snapshots on Amazon S3 with Kerberos enabled
HBaseMapReduceIndexerTool command line reference
HBCK2 tool command reference
HDFS
HDFS
HDFS ACLs
HDFS Block Skew
HDFS Caching
HDFS commands for metadata files and directories
HDFS Metrics
HDFS Overview
HDFS storage policies
HDFS storage types
HDFS storage types
Heap sampling
HeapDumpPath (/tmp) in Hive data nodes gets full due to .hprof files
Hierarchical queue characteristics
High Availability on HDFS clusters
Hive
Hive
Hive 3 ACID transactions
Hive Authentication
Hive Warehouse Connector API Examples
Hive Warehouse Connector for accessing Apache Spark data
Hive Warehouse Connector Interfaces
HiveServer actions that produce Atlas entities
HiveServer audit entries
HiveServer entities created in Atlas
HiveServer is unresponsive due to large queries running in parallel
HiveServer lineage
HiveServer metadata collection
HiveServer relationships
HiveWarehouseSession API operations
HMS table storage
HMS table storage
How Cloudera Search Works
How NameNode manages blocks on a failed DataNode
How NFS Gateway authenticates and maps users
How Ozone manages read operations
How Ozone manages write operations
How tag-based access control works
HttpFS authentication
Hue
Hue
Hue configuration files
Hue logs
Hue Overview
Hue safety valves
Hue supported browsers
HWC supported types
IAM Role permissions for working with SSE-KMS
Identifiers
Identifying Problems
Impala
Impala
Impala actions that produce Atlas entities
Impala audit entries
Impala Authentication
Impala Authorization
Impala database containment model
Impala DDL for Kudu
Impala DML for Kudu Tables
Impala entities created in Atlas
Impala integration limitations
Impala lineage
Impala lineage
Impala Logs
Impala metadata collection
Impala Shell Command Reference
Impala Shell Configuration File
Impala Shell Configuration Options
Impala Shell Tool
Impala SQL
Impala SQL and Hive SQL
Impala with Amazon S3
Impala with Azure Data Lake Store (ADLS)
Impala with HBase
Impala with HDFS
Impala with Kudu
Import command options
Import RDBMS data into Hive
Import RDBMS data to HDFS
Import resource-based policies for a specific service
Import resource-based policies for all services
Import tag-based policies
Importing a Bucket into S3Guard
Importing and exporting resource-based policies
Importing and exporting tag-based policies
Importing data into HBase
Improving Performance for S3A
Improving performance using partitions
Improving performance with centralized cache management
Improving performance with short-circuit local reads
Improving Software Performance
Increasing StateStore Timeout
Increasing storage capacity with HDFS compression
Incrementally update an imported table
Index Sample Data
Indexing
Indexing Data
Indexing Data Using Morphlines
Indexing Sample Tweets with Cloudera Search
Information and debugging
Ingestion
Initiate replication when data already exist
INSERT and primary key uniqueness violations
Insert data into an ACID table
INSERT statement
Inserting a row
Inserting in bulk
Installing CDS 3
Installing Hive on Tez and adding a HiveServer role
Installing NTP
Installing the REST Server using Cloudera Manager
Installing the UDF development package
INT data type
Integrating Apache Hive with Apache Spark, Apache Kafka, and BI
Integrating Hive and a BI tool
Integrating your identity provider's SAML server with Hue
Interacting with Hive views
Internal and external Impala tables
Internal private key infrastructure (PKI)
Introducing the S3A Committers
Introduction
Introduction
Introduction
Introduction
Introduction
Introduction
Introduction
Introduction to HDFS metadata files and directories
Introduction to Ozone
Introduction to S3Guard
INVALIDATE METADATA statement
ISR management
Issues starting or restarting the master or the tablet server
Java API example
JBOD
JBOD Disk migration
JBOD setup
JDBC connection string syntax
JDBC connection string syntax
Joins in Impala SELECT statements
JournalNodes
JournalNodes
JVM and garbage collection
Kafka
Kafka
Kafka Architecture
Kafka brokers and Zookeeper
Kafka clients and ZooKeeper
Kafka consumers
Kafka FAQ
Kafka Introduction
Kafka producers
Kafka public APIs
Kafka security hardening with Zookeeper ACLs
Kafka storage handler and table properties
Kafka Streams
kafka-*-perf-test
kafka-configs
kafka-console-consumer
kafka-console-producer
kafka-consumer-groups
kafka-delegation-tokens
kafka-log-dirs
kafka-reassign-partitions
kafka-topics
Kafka-ZooKeeper performance tuning
Keep replicas current
Kerberos authentication
Kerberos configuration for Ozone
Kerberos principal and keytab properties for Ozone service daemons
Kerberos setup guidelines for Distcp between secure clusters
Kernel stack watchdog traces
Killing an application
Known issue: Ranger group mapping
Known issues and limitations
Known issues and limitations
Known Issues In Cloudera Runtime 7.0.3
Kudu
Kudu
Kudu architecture in a CDP private cloud base deployment
Kudu authentication with Kerberos
Kudu example applications
Kudu integration with Spark
Kudu master web interface
Kudu metrics
Kudu Python client
Kudu security
Kudu tablet server web interface
Kudu tracing
Kudu web interfaces
Kudu-Impala integration
LAG
LAST_VALUE
Launch distcp
Launch the Service YARN file
LAZY_PERSIST memory storage policy
LDAP authentication
LDAP properties
LEAD
Leader positions and in-sync replicas
Lily HBase Batch Indexing for Cloudera Search
Lily HBase Near Real Time Indexing for Cloudera Search
LIMIT clause
Limit concurrent connections
Limit CPU usage with Cgroups
Limitations and restrictions for Impala UDFs
Limitations of Amazon S3
Limitations of erasure coding
Limitations of the S3A Committers
Limiting the speed of compactions
Lineage lifecycle
Lineage overview
Linux Container Executor
List files in Hadoop archives
Listing available metrics
Literals
LOAD DATA statement
Loading ORC data into DataFrames using predicate push-down
Loading the Oozie database
Locating Hive tables and changing the location
Log Aggregation File Controllers
Log aggregation properties
Log cleaner
Log redaction
Logical operators, comparison operators and comparators
Logical replication
Logs and log segments
Low-latency analytical processing
Maintenance manager
Manage and monitor services
Manage databases and tables
Manage HBase snapshots on Amazon S3 in Cloudera Manager
Manage HBase snapshots using Cloudera Manager
Manage HBase snapshots using the HBase shell
Manage individual delegation tokens
Manage long-running YARN applications
Manage partition retention time
Manage partitions
Manage Policies for HBase snapshots in Amazon S3
Manage queries
Manage query rewrites
Manage reports
Management basics
Managing
Managing Access Control Lists
Managing and Allocating Cluster Resources using Capacity Scheduler
Managing Apache HBase
Managing Apache HBase Security
Managing Apache Hive
Managing Apache Impala
Managing Apache Kafka
Managing Apache ZooKeeper
Managing Apache ZooKeeper Security
Managing Applications on Apache Hadoop YARN
Managing Auditing with Ranger
Managing Business Terms with Atlas Glossaries
Managing Cloudera Search
Managing Cloudera Search Configuration
Managing Collections in Cloudera Search
Managing columns
Managing Configs
Managing Configuration Using Configs or Instance Directories
Managing Data Storage
Managing disk space for Impala data
Managing Instance Directories
Managing Kudu with Cloudera Manager
Managing Logs
Managing Metadata in Impala
Managing partitions
Managing Resources in Impala
Managing snapshot policies using Cloudera Manager
Managing storage elements by using the command-line interface
Managing tables
Managing the YARN service life cycle through the REST API
Managing topics across multiple Kafka clusters
Managing YARN queue users
Manually configuring SAML authentication
Manually failing over to the standby NameNode
MAP complex type
Mapping for an Ozone volume in Amazon S3 API
Mapping Phoenix Schemas to HBase Namespaces
MapReduce Application ACL
MapReduce Indexing
MapReduceIndexerTool
MapReduceIndexerTool Input Splits
MapReduceIndexerTool Metadata
MapReduceIndexerTool Usage Syntax
Master
Mathematical functions
Maven artifacts
Maven Artifacts for Cloudera Runtime 7.0.3.0
MAX
MAX function
Maximizing storage resources using ORC
Memory
Memory limits
Merge data in tables
Merge process stops during Sqoop incremental imports
Metrics
Migrate brokers by modifying broker IDs in meta.properties
Migrating Data Using Sqoop
Migrating Kudu data from one directory to another on the same host
Migrating Solr replicas
Migrating to multiple Kudu masters
Migration Guide
MIN
MIN function
Minimizing cluster disruption during temporary planned downtime of a single tablet server
Miscellaneous functions
Modifying Impala Startup Options
Monitor applications
Monitor clusters
Monitor nodes
Monitor queues
Monitor RegionServer grouping
Monitor the BlockCache
Monitor the performance of hedged reads
Monitoring
Monitoring and Debugging Spark Applications
Monitoring and Maintaining S3Guard
Monitoring cluster health with ksck
Monitoring clusters using YARN web user interface
Monitoring heap memory usage
Monitoring Impala
Monitoring NTP status
More Resources
Move HBase Master Role to another host
Moving a NameNode to a different host using Cloudera Manager
Moving data from databases to Apache Hive
Moving data from HDFS to Apache Hive
Moving highly available NameNode, failover controller, and JournalNode roles using the Migrate Roles wizard
Moving NameNode roles
Moving the JournalNode edits directory for a role group using Cloudera Manager
Moving the JournalNode edits directory for a role instance using Cloudera Manager
Multilevel partitioning
NameNode architecture
NameNodes
NameNodes
NDV function
Near Real Time Indexing
Network and I/O threads
Networking parameters
Next steps
Non-covering range partitions
Notes about replication
NTILE
NTP clock synchronization
NTP configuration best practices
Off-heap BucketCache
OFFSET clause
On-demand Metadata
Oozie
Oozie
Oozie configurations with CDP services
Oozie database configurations
Oozie High Availability
Oozie scheduling examples
Operating system requirements
Operational Database
Operational Database
Operators
Optimize mountable HDFS
Optimizer hints
Optimizing data storage
Optimizing HBase I/O
Optimizing NameNode disk space with Hadoop archives
Optimizing performance
Optimizing performance for evaluating SQL predicates
Optimizing queries using partition pruning
Optimizing S3A read performance for different file types
Options to determine differences between contents of snapshots
Options to run distributed shell and GPU
ORC vs Parquet in CDP
Orchestrating SQL and APIs with Apache Phoenix
ORDER BY clause
Other known issues
OVER
Overview
Overview
Overview
Overview of Hadoop archives
Overview of HDFS
Overview of Oozie
Overview of Proxy Usage and Load Balancing for Search
Ozone
Ozone architecture
Packaging different versions of libraries with an Apache Spark application
Parameters to configure the Disk Balancer
Partition a cluster using node labels
Partition pruning
Partition Pruning for Queries
Partitioning
Partitioning
Partitioning examples
Partitioning for Kudu Tables
Partitioning guidelines
Partitioning limitations
Partitioning tables
Partitions
Partitions introduction
PERCENT_RANK
Perform a backup of the HDFS metadata
Perform a disk hot swap for DataNodes using Cloudera Manager
Perform ETL by ingesting data from Kafka into Hive
Perform hostname changes
Perform scans using HBase Shell
Perform the migration
Perform the recovery
Perform the removal
Performance and storage considerations for Spark SQL DROP TABLE PURGE
Performance Best Practices
Performance considerations
Performance Considerations
Performance considerations for UDFs
Performance Impact of Encryption
Performance tuning
Phoenix
Phoenix Overview
Physical backups of an entire node
Plan the data movement across disks
Planning for Apache Impala
pom.xml
Populating an HBase Table
Populating an S3 bucket
Ports Used by Impala
Post-migration verification
Predicate push-down optimization
Preloaded resource-based services and policies
Prepare for hostname changes
Prepare for removal
Prepare for the migration
Prepare for the recovery
Prepare to back up the HDFS metadata
Preparing the hardware resources for HDFS High Availability
Preparing to Index Sample Tweets with Cloudera Search
Prerequisite
Prerequisites for configuring short-ciruit local reads
Prerequisites for configuring TLS/SSL for Oozie
Prerequisites for enabling erasure coding
Prerequisites for enabling HDFS HA using Cloudera Manager
Prerequisites to configure TLS/SSL for HBase
Previewing tables using Data Preview
Primary key design
Primary key index
Propagating classifications through lineage
Properties for configuring centralized caching
Properties for configuring short-circuit local reads on HDFS
Properties for configuring the Balancer
Properties to set the size of the NameNode edits directory
Protocol between consumer and broker
Proxy users for Kerberos-enabled clusters
Pruning Old Data from S3Guard Tables
Query correlated data
Query fails with "Counters limit exceeded" error message
Query Join Performance
Query live data from Kafka
Query options
Query Sample Data
Query the information_schema database
Query vectorization
Querying
Querying an existing Kudu table from Impala
Querying files into a DataFrame
Querying Kafka data
Quota enforcement
Quota violation policies
Quotas
Rack awareness (Location awareness)
Raft consensus algorithm
Range partitioning
Range partitioning
Ranger
Ranger
Ranger access conditions
Ranger AD Integration
Ranger console navigation
Ranger Policies Overview
Ranger Security Zones
Ranger tag-based policies
Ranger UI authentication
Ranger UI authorization
Ranger user management
Ranger Usersync
RANK
Read and write operations
Read operations (scans)
Read replica properties
Reading data from HBase
Reading Hive ORC tables
Reads (scans)
REAL data type
Reassigning replicas between log directories
Reassignment examples
Rebalancing partitions
Rebuilding a Kudu filesystem layout
Recommendations for using the producer and consumer APIs
Recommended configurations for the Balancer
Recommended configurations for the balancer
Recommended settings for G1GC
Record management
Record order and assignment
Records
Recover data from a snapshot
Recovering from a dead Kudu master in a multi-master deployment
Recovering from disk failure
Recovering from full disks
Redeploying the Oozie ShareLib
Redeploying the Oozie sharelib using Cloudera Manager
Reducing the Size of Data Structures
Reference architecture
Referencing S3 Data in Applications
Refining query search using filters
REFRESH AUTHORIZATION statement
REFRESH FUNCTIONS statement
REFRESH statement
Register the UDF
Registering a Lily HBase Indexer Configuration with the Lily HBase Indexer Service
Reload, view, and filter functions
Remove a DataNode
Remove a RegionServer from RegionServer grouping
Remove storage directories using Cloudera Manager
Removing Kudu masters from a multi-master deployment
Repair partitions manually using MSCK repair
Replace a disk on a DataNode host
Replace a ZooKeeper disk
Replace a ZooKeeper role on an unmanaged cluster
Replace a ZooKeeper role with ZooKeeper service downtime
Replace a ZooKeeper role without ZooKeeper service downtime
Replicate pre-exist data in an active-active deployment
Replication
Replication across three or more clusters
Replication caveats
Replication requirements
Reporting Kudu crashes using breakpad
Request a timeline-consistent read
Requirements for Oozie High Availability
Reserved words
Resource Distribution Process - Example
Resource Distribution Workflow
Resource Tuning Example
Resource-based Services and Policies
REST endpoints supported on Ozone S3 Gateway
Restore an HBase snapshot from Amazon S3
Restore an HBase snapshot from Amazon S3 with a new name
Restore data from a replica
Restore HDFS metadata from a backup using Cloudera Manager
Restoring a Solr Collection
Restoring NameNode metadata
Restrict access to Kafka metadata in Zookeeper
Restricting which ciphers are supported
Retries
Retrieving log directory replica assignment information
REVOKE statement
Rotate Auto-TLS Certificate Authority and Host Certificates
Rotate the master key/secret
Row-level filtering and column masking in Hive
Row-level filtering in Hive with Ranger policies
ROW_NUMBER
RPC timeout traces
Run a Hive command
Running a Spark MLlib example
Running a tablet rebalancing tool in Cloudera Manager
Running a tablet rebalancing tool on a rack-aware cluster
Running Apache Spark Applications
Running Commands and SQL Statements in Impala Shell
Running HBaseMapReduceIndexerTool
Running PySpark in a virtual environment
Running sample Spark applications
Running shell commands
Running Spark applications on secure clusters
Running Spark applications on YARN
Running Spark Python applications
Running tablet rebalancing tool
Running the balancer
Running the HBCK2 tool
Running your first Spark application
Runtime environment for UDFs
Runtime error: Could not create thread: Resource temporarily unavailable (error 11)
Runtime Filtering
S3 Performance Checklist
S3A and Checksums (Advanced Feature)
S3Guard: Operational Issues
Safely Writing to S3 Through the S3A Committers
SAML properties
Sample pom.xml file for Spark Streaming with Kafka
Save the YARN file as Service App
Saving searches
Saving the search results
Scalability
Scalability Considerations
Scaling Kudu
Scaling Limits and Guidelines
Scaling recommendations and limitations
Scaling storage on Kudu master and tablet servers in the cloud
Scheduling Among Queues
Scheduling in Oozie using cron-like syntax
Schema alterations
Schema design limitations
Schema design limitations
Schema objects
Schemaless Mode Overview and Best Practices
Script with HBase Shell
Search
Search
Search an application
Search and other Runtime components
Search Ranger reports
Search Tutorial
Searching for entities using classifications
Searching metadata tags
Searching overview
Searching queries
Searching tables
Searching using terms
Searching with Metadata
Secondary Sort
Secure Hive Metastore
Secure HiveServer using LDAP
Securing Apache Hive
Securing Apache Kafka
Securing Atlas
Securing Cloudera Search
Securing configs with ZooKeeper ACLs and Ranger
Securing database connections with TLS/SSL
Securing DataNodes
Securing Hue
Securing Hue passwords with scripts
Securing Impala
Securing sessions
Securing the S3A Committers
Security
Security considerations
Security considerations for UDFs
Security limitations
Security Model and Operations on S3
Security tokens in Ozone
SELECT statement
Server management limitations
Set application limit for a specific queue
Set Application Limits
Set Application Master Resource Limit
Set Application Master resource limit for a specific queue
Set Application Priority
Set consumer and producer properties as table properties
Set Flexible Scheduling Policies
Set HADOOP_CONF to the destination cluster
Set properties in Cloudera Manager
Set Proxy Server Authentication for Clusters Using Kerberos
Set quotas using Cloudera Manager
SET statement
Set up a JDBC URL connection override
Set up a PostgreSQL database
Set up a storage policy for HDFS
Set up MirrorMaker in Cloudera Manager
Set up Queues
Set Up Sqoop
Set up SSD storage using Cloudera Manager
Set up the cost-based optimizer and statistics
Set up the development environment
Set up WebHDFS on a secure cluster
Set User Limits
Setting HDFS quotas
Setting Java System Properties for Solr
Setting Lucene Version
Setting Oozie permissions
Setting the cache timeout
Setting the Idle Query and Idle Session Timeouts
Setting the Oozie database timezone
Setting the trash interval
Setting Timeout and Retries for Thrift Connections to Backend Client
Setting Timeouts in Impala
Setting up Data Cache for Remote Reads
Setting Up HDFS Caching
Setting up OzoneFS
Setting up the backend Hive metastore database
Setting up the metastore database
Setting user limits for HBase
Setting user limits for Kafka
Settings to avoid data loss
Shell commands
Show materialized views
SHOW MATERIALIZED VIEWS
SHOW statement
SHUTDOWN statement
Simple Client Examples
SimpleConsumer.java
SimpleProducer.java
Single tablet write operations
Size the BlockCache
Sizing estimation based on network and disk message throughput
Sizing NameNode heap memory
Slow name resolution and nscd
SMALLINT data type
Snapshot failures
Solr and HDFS - the Block Cache
Solr Server Tuning Categories
solrctl Reference
Space quotas
Spark
Spark
Spark actions that produce Atlas entities
Spark Application ACL
Spark application model
Spark audit entries
Spark cluster execution overview
Spark entities created in Apache Atlas
Spark execution model
Spark Indexing
Spark integration best practices
Spark integration known issues and limitations
Spark integration limitations
Spark lineage
Spark metadata collection
Spark on YARN deployment modes
Spark relationships
Spark security
Spark SQL example
Spark Streaming and Dynamic Allocation
Spark Streaming Example
Spark troubleshooting
spark-submit command options
Specify the JDBC connection string
Specify truststore properties
Specifying domains or pages to which Hue can redirect users
Specifying HTTP request methods
Specifying Impala Credentials to Access S3
Specifying racks for hosts
Speeding up Job Commits by Increasing the Number of Threads
Spooling Query Results
SQL migration
SQL statements
SQLContext and HiveContext
Sqoop
Sqoop Hive import stops when HS2 does not use Kerberos authentication
SSE-C: Server-Side Encryption with Customer-Provided Encryption Keys
SSE-KMS: Amazon S3-KMS Managed Encryption Keys
SSE-S3: Amazon S3-Managed Encryption Keys
Start and Stop Queues
Start and stop the NFS Gateway services
Start compaction manually
Start HBase
Start Hive on an insecure cluster
Start the Hive shell in a secure cluster
Starting and stopping HBase using Cloudera Manager
Starting and stopping Kudu processes
Starting Apache Hive
Starting the Lily HBase NRT Indexer Service
Starting the Oozie server
Statistics generation and viewing commands
STDDEV, STDDEV_SAMP, STDDEV_POP functions
Step 1: Generate keys and certificates for Kafka brokers
Step 1: Worker host configuration
Step 2: Create your own certificate authority
Step 2: Worker host planning
Step 3: Cluster size
Step 3: Sign the certificate
Step 4: Configure Kafka brokers
Step 5: Configure Kafka clients
Step 6: Verify container settings on cluster
Step 6A: Cluster container capacity
Step 6B: Container sanity checking
Step 7: MapReduce configuration
Step 7A: MapReduce sanity checking
Steps 4 and 5: Verify settings
Stop HBase
Stop replication in an emergency
Stopping Impala
Stopping the Oozie server
Storage
Storage
Storage group classification
Storage group pairing
Storage Systems Supports
Storage-based operation permissions
Store HBase snapshots on Amazon S3
Storing Data Using Ozone
Streams Messaging
STRING data type
String functions
STRUCT complex type
Submit an HWC Python app
Submit an HWC Scala or Java application
Submitting Spark applications
Submitting Spark Applications to YARN
Subqueries in Impala SELECT statements
Subquery restrictions
Subscribing to a topic
SUM
SUM function
Switching from CMS to G1GC
Synchronize table data using HashTable/SyncTable tool
Synchronizing the contents of JournalNodes
Synchronizing users and groups with an LDAP server
System Level Broker Tuning
Table
Table and Column Statistics
Tables
TABLESAMPLE clause
Tablet
Tablet history garbage collection and the ancient history mark
Tablet server
Tag-based Services and Policies
Tags and policy evaluation
Take a snapshot using a shell script
Take HBase snapshots
Terms
Testing the LDAP configuration
The certmanager utility
The Cloud Storage Connectors
The HDFS mover command
The Hue load balancer not distributing users evenly across various Hue servers
The perfect schema
The S3A Committers and Third-Party Object Stores
Thin Client connectivity with Phoenix Query Server
Thread Tuning for S3A Data Upload
Threads
Thrift Server crashes after receiving invalid data
Timeline consistency
TIMESTAMP compatibility for Parquet files
TIMESTAMP data type
TINYINT data type
TLS
Tombstoned or STOPPED tablet replicas
Tool usage
Tools
Topics
Transactional table access
Transactions
Trash behavior with HDFS Transparent Encryption enabled
Troubleshoot RegionServer grouping
Troubleshooting
Troubleshooting
Troubleshooting Apache HBase
Troubleshooting Apache Hive
Troubleshooting Apache Impala
Troubleshooting Apache Kudu
Troubleshooting Apache Kudu
Troubleshooting Apache Sqoop
Troubleshooting Cloudera Search
Troubleshooting HBase
Troubleshooting Hue
Troubleshooting Impala
Troubleshooting NTP stability problems
Troubleshooting performance issues
Troubleshooting S3 and S3Guard
Troubleshooting SAML authentication
Troubleshooting the S3A Committers
TRUNCATE TABLE statement
Tuning Apache Kafka Performance
Tuning Apache Spark
Tuning Apache Spark Applications
Tuning Cloudera Search
Tuning Garbage Collection
Tuning Hue
Tuning Impala
Tuning Replication
Tuning Resource Allocation
Tuning S3A Uploads
Tuning Spark Shuffle Operations
Tuning the metastore
Tuning the Number of Partitions
Turning safe mode on HA NameNodes
Tutorial
UDF concepts
Unable to authenticate users in Hue using SAML
Understanding
Understanding --go-live and HDFS ACLs
Understanding erasure coding policies
Understanding HBase garbage collection
Understanding Performance using EXPLAIN Plan
Understanding Performance using Query Profile
Understanding Performance using SUMMARY Report
Understanding the extractHBaseCells Morphline Command
Understanding the extractHBaseCells Morphline Command
Understanding the kafka-run-class Bash Script
Understanding User-Defined Functions (UDFs) in Phoenix
Understanding YARN architecture
UNION clause
Unlock Kafka metadata in Zookeeper
Unsupported Apache Spark Features
Unsupported command line tools
Unsupported Interfaces and Features
Update data in a table
UPDATE statement
Updated CDH Components
Updated HDP Components
Updating a row
Updating in bulk
Updating the Schema in a Solr Collection
Uploading tables
Upsert option in Kudu Spark
UPSERT statement
Upserting a row
URL schema for Ozone S3 Gateway
URL to browse Ozone buckets
Usability issues
Use a CTE in a query
Use a custom MapReduce job
Use a materialized view in a subquery
Use a subquery
Use BulkLoad
Use cases
Use cases for ACLs on HDFS
Use cases for BulkLoad
Use cases for centralized cache management
Use cases for HBase
Use cluster replication
Use CopyTable
Use CPU scheduling
Use curl to access a URL protected by Kerberos HTTP SPNEGO
Use dfs.datanode.max.transfer.threads with Hbase
Use DNS with HBase
Use GZipCodec with a one-time job
Use HashTable and SyncTable Tool
Use indexes in Phoenix
Use log aggregation
Use multiple ZooKeeper services
Use node labels
Use rsync to copy files from one broker to another
Use snapshots
Use Spark
Use Sqoop
USE statement
Use the Apache Thrift Proxy API
Use the HBase APIs for Java
Use the HBase command-line utilities
Use the HBase REST server
Use the HBase shell
Use the Hive Warehouse Connector for streaming
Use the Hue HBase app
Use the Network Time Protocol (NTP) with HBase
Use the Phoenix client to load data
Use the YARN CLI to view logs for applications
Use the YARN REST APIs to manage applications
Use the yarn rmadmin tool to Administer ResourceManager High Availability
Use the YARN Services API
User Account Requirements
User permissions
User-defined functions (UDFs)
Using --go-live with SSL or Kerberos
Using a credential provider to secure S3 credentials
Using advanced search
Using Amazon S3 with Apache HBase
Using Amazon S3 with Hue
Using Apache HBase Backup and Disaster Recovery
Using Apache Hive
Using Apache Impala with Apache Kudu
Using Apache Impala with Apache Kudu
Using Avro Data Files
Using Basic Search
Using Breakpad Minidumps for Crash Reporting
Using Cgroups
Using chrony for time synchronization
Using CLI commands to create and list ACLs
Using Cloudera Manager to manage HDFS HA
Using cluster names in the kudu command line tool
Using common table expressions
Using constraints
Using custom libraries with Spark
Using Data Analytics Studio
Using DistCp
Using DistCp between HA clusters using Cloudera Manager
Using DistCp to copy files
Using DistCp with Amazon S3
Using DistCp with Highly Available remote clusters
Using EC2 Instance Metadata to Authenticate
Using erasure coding for existing data
Using erasure coding for new data
Using Free-text Search
Using functions
Using governance-based data discovery
Using HBase blocksize
Using HBase coprocessors
Using HBase replication
Using HBase scanner heartbeat
Using HDFS snapshots for data protection
Using HdfsFindTool to find files
Using hedged reads
Using HttpFS to provide access to HDFS
Using Hue
Using Hue
Using Impala to query Kudu tables
Using JdbcStorageHandler to query RDBMS
Using JdbcStorageHandler to query RDBMS
Using JMX for accessing HDFS metrics
Using Kafka's inter-broker security
Using Load Balancer with HttpFS
Using MapReduce Batch Indexing to Index Sample Tweets
Using materialized views
Using ORC Data Files
Using Ozone S3 Gateway to work with storage elements
Using Parquet Data Files
Using PySpark
Using quota management
Using rack awareness for read replicas
Using Ranger to Provide Authorization in CDP
Using Ranger with Ozone
Using RCFile Data Files
Using RegionServer grouping
Using S3Guard for Consistent S3 Metadata
Using scheduling to allocate resources
Using SequenceFile Data Files
Using solrctl with an HTTP proxy
Using Spark MLlib
Using Spark SQL
Using Spark Streaming
Using Spark with a secure Kudu cluster
Using Sqoop actions with Oozie
Using tag attributes and values in Ranger tag-based policy conditions
Using Text Data Files
Using the CDS 3 Maven Repo
Using the Charts Library with the Kudu service
Using the Cloudera Runtime Maven Repository
Using the Database Explorer
Using the Directory Committer in MapReduce
Using the HBCK2 tool to remediate HBase clusters
Using the Indexer HTTP Interface
Using the Lily HBase NRT Indexer Service
Using the NFS Gateway for accessing HDFS
Using the Ranger Console
Using the REST API
Using the REST proxy API
Using the S3Guard CLI
Using the S3Guard Command to List and Delete Uploads
Using the Spark DataFrame API
Using Unique Filenames to Avoid File Update Inconsistency
Using YARN with a secure cluster
Validating the Cloudera Search Deployment
VALUES statement
VARCHAR data type
VARIANCE, VARIANCE_SAMP, VARIANCE_POP, VAR_SAMP, VAR_POP functions
Variations on Put
Verify that replication works
Verify the ZooKeeper authentication
Verify validity of the NFS services
Verifying if a memory limit is sufficient
Verifying That an S3A Committer Was Used
Verifying that Indexing Works
Verifying that S3Guard is Enabled on a Bucket
Verifying the Impala dependency on Kudu
Versions
View application details
View audit details
View compaction progress
View query details
View Ranger reports
View transaction locks
View transactions
Viewing application logs
Viewing detailed information
Viewing Existing Solr Collections
Viewing lineage
Viewing racks assigned to cluster hosts
Viewing storage information
Viewing table and column statistics
Viewing the API documentation
Viewing the DAG counters
Viewing the DAG flow
Viewing the Hive configurations for a query
Viewing the Join report
Viewing the query details
Viewing the query recommendations
Viewing the query timeline
Viewing the Read and Write report
Viewing the task-level DAG information
Viewing the visual explain for a query
Views
Virtual machine options for HBase Shell
Virtual memory handling
Web UI encryption
Web UI redaction
Web User Interface for Debugging
What's New
When Shuffles Do Not Occur
When to Add a Shuffle Transformation
When to use Atlas classifications for access control
Why HDFS data becomes unbalanced
Wildcards and variables in resource-based policies
WINDOW
WITH clause
Work preserving recovery for YARN components
Working with Amazon S3
Working with Apache Hive Metastore
Working with Atlas classifications and labels
Working with Classifications and Labels
Working with Ozone ACLs
Working with Ozone File System
Working with S3 buckets in the same AWS region
Working with the Oozie server
Working with Third-party S3-compatible Object Stores
Working with versioned S3 buckets
Write transformed Hive data to Kafka
Write-ahead log garbage collection
Writes
Writing data to HBase
Writing data to Kafka
Writing to multiple tablets
Writing UDFs
Writing user-defined aggregate functions (UDAFs)
YARN
YARN
YARN ACL rules
YARN ACL syntax
YARN ACL types
YARN Admin ACLs
YARN Application ACLs
YARN Features
YARN resource allocation
YARN ResourceManager High Availability
YARN ResourceManager High Availability architecture
YARN Services API Examples
YARN tuning overview
YARN Unsupported Features
ZooKeeper
ZooKeeper ACLs Best Practices
ZooKeeper ACLs Best Practices: Atlas
ZooKeeper ACLs Best Practices: HBase
ZooKeeper ACLs Best Practices: HDFS
ZooKeeper ACLs Best Practices: Kafka
ZooKeeper ACLs Best Practices: Oozie
ZooKeeper ACLs Best Practices: Ranger
ZooKeeper ACLs best practices: Search
ZooKeeper ACLs Best Practices: YARN
ZooKeeper ACLs Best Practices: ZooKeeper
ZooKeeper Authentication
zookeeper-security-migration

«

Filter topics

Kafka FAQ

Kafka Introduction
▶︎Kafka Architecture
▼Kafka FAQ
1. Basics
2. Use cases

»

Apache Kafka Overview

Kafka FAQ

A collection of frequently asked questions on the topic of Kafka.

Basics
A collection of frequently asked questions on the topic of Kafka aimed for beginners.
Use cases
A collection of frequently asked questions on the topic of Kafka aimed for advanced users.

© 2019–2021 by Cloudera, Inc. All rights reserved.

We want your opinion

How can we improve this page?

What kind of feedback do you have?

Can we contact you for follow-up on this?

7.3.1
7.1
1. 7.1.9
2. 7.1.8
3. 7.1.7
4. 7.1.6
5. 7.1.5
6. 7.1.4
7. 7.1.3
8. 7.1.2
9. 7.1.1
7.0.3