Cloudera Docs

Data Sharing longevity test results

Data Sharing longevity test results provide performance benchmarks for Cloudera Data Catalog and Cloudera Iceberg REST Catalog across 72-hour stress tests to measure throughput, error rates, and system stability.

Test environment and dataset

The longevity test was conducted on an AWS Enterprise Data Lake cluster with the following dataset configuration:

Table 1. Cloudera Data Catalog longevity test dataset
Configuration item Value
Databases 50
Tables 100
Columns 1000
Snapshots 0
Data Shares 1000
Tables per Data Share 5
Users 200
Users per Data Share 200
Table 2. Cloudera Iceberg REST Catalog longevity test dataset
Configuration item Value
Databases 250
Tables 20
Columns 1000
Snapshots 100
Data Shares 100
Tables per Data Share 15
Users per Data Share 501
1 Each user accessed one table from one database up to 50 Data Shares.

The following table displays the longevity test results for 50 concurrent users on the AWS EDL cluster environment:

Component Users or Threads Duration Throughput Total requests Failed requests Error %
Cloudera Data Catalog 2 50 72 hours 2.03/s 527373 62 0.01%
Cloudera Iceberg REST Catalog 50 72 hours 33.90/s 8787271 0 0.00%
2 The default Ranger heap size was 1 GB.