Cloudera Docs

Third-Party filesystem support: Dell EMC PowerScale (OneFS)

This document provides the requirements, supported software version matrices, and upgrade paths for integrating Dell EMC PowerScale (OneFS) with Cloudera Manager, Cloudera Runtime (Cloudera Base on premises), and Cloudera Data Services on premises.

Cloudera Base on premises version compatibility with Dell EMC PowerScale (OneFS)

The following table lists the supported combinations of Cloudera Manager, Cloudera Runtime, and Dell PowerScale (OneFS) versions.

Table 1. Dell EMC PowerScale (OneFS) and Cloudera Base on premises version matrix
Cloudera Manager version Cloudera Runtime version Dell EMC PowerScale version requirements and notes
7.13.2.0 7.3.2.0 PowerScale version 9.10
7.13.1 CHF4 7.1.9 SP1 CHF10 PowerScale version 9.10
7.13.1 7.3.1
PowerScale version 9.7
  • ECS version 3.8 (ECS as SFS with HDFS as primary)
7.11.3 CHF7 7.1.9 SP1
PowerScale version 9.7
  • ECS version 3.8 (ECS as SFS with HDFS as primary)
7.11.3 CHF5 7.1.9 CHF6

PowerScale version 9.5
7.11.3 CHF4 7.1.9 CHF4

PowerScale version 9.5
7.11.3 CHF2 7.1.9 CHF2

PowerScale version 9.5
7.11.3 CHF1 7.1.9 CHF1
PowerScale version 9.5
  • ECS version 3.8 (ECS as SFS with HDFS as primary)
7.11.3 CHF7 7.1.7 SP3 CHF2

PowerScale version 9.7
7.11.3 CHF6 7.1.7 SP3 CHF1

PowerScale version 9.7
7.11.3 CHF5 7.1.7 SP3
PowerScale version 9.5
  • ECS version 3.8 (ECS as SFS with HDFS as primary)
7.6.7 CHF11 7.1.7 SP2 CHF17 PowerScale version 9.5
7.6.7 7.1.7 SP2
PowerScale version 9.3
  • ECS version 3.7 (ECS as SFS with HDFS as primary)
7.7.1 CHF18 7.1.8 CHF20

PowerScale version 9.5
7.7.1 CHF17 7.1.8 CHF18

PowerScale version 9.5
7.7.1 CHF16 7.1.8 CHF17

PowerScale version 9.5
7.7.1 7.1.8
PowerScale version 9.3
  • ECS version 3.7 (ECS as SFS with HDFS as primary)
7.6.1 7.1.7 SP1
PowerScale versions 9.2, 9.3
  • ECS version: 3.6.2.0 (ECS as SFS with HDFS as primary)
7.4.4 7.1.7 OneFS 8.2.2
7.3.1 7.1.6 OneFS 8.2.2

See Dell documentation: Hadoop Distributions and Products Supported by OneFS

Cloudera Data Services on premises version compatibility with Dell EMC PowerScale (OneFS)

The following table lists the supported version combinations for Cloudera Manager, Cloudera Runtime, and Cloudera Data Services on premises with Dell EMC PowerScale (OneFS) versions.

Table 2. Dell EMC PowerScale (OneFS) and Cloudera Data Services on premises version matrix
Cloudera Manager version Cloudera Runtime version Cloudera Data Services on premises version Dell EMC PowerScale version requirements and notes
7.13.1.402 CHF4 7.1.9.1040 SP1 CHF5 1.5.5 PowerScale version 9.10
7.11.3.28 CHF11 7.1.9.1023 SP1 CHF4 1.5.4 SP1

PowerScale version 9.9
7.11.3.11 CHF 7 7.1.9 SP1 1.5.4

PowerScale version 9.7

Supported in-place upgrade paths for Dell EMC PowerScale (OneFS)

This section outlines the supported in-place upgrade paths for Cloudera Base on premises, legacy CDH or HDP platforms, and Cloudera Manager when integrated with Dell PowerScale (OneFS) storage.

Cloudera Base on premises in-place upgrades
Source version (Source Cloudera Manager version) Target version (Target Cloudera Manager version) Notes

Cloudera Runtime 7.1.9 SP1 CHF10

Cloudera Runtime 7.3.2.0

(Cloudera Manager 7.13.2.0)

 In-place upgrade supported.

Cloudera Runtime 7.1.9 SP1

(Cloudera Manager 7.11.3 CHF7)

Cloudera Runtime 7.3.1

(Cloudera Manager 7.13.1)

 In-place upgrade supported.

Cloudera Runtime 7.1.9 SP1

(Cloudera Manager 7.11.3 CHF7)

Cloudera Runtime 7.1.9 SP1 CHF10

(Cloudera Manager 7.13.1 CHF4)

 In-place upgrade supported.

Cloudera Runtime 7.1.8

(Cloudera Manager 7.7.3 CHF2)

 Cloudera Runtime 7.1.9 CHF1 In-place upgrade supported.

Cloudera Runtime 7.1.7 SP2

(Cloudera Manager 7.6.7)

 Cloudera Runtime 7.1.9 CHF1 In-place upgrade supported.
Cloudera Runtime 7.1.7 Cloudera Runtime 7.1.8 In-place upgrade supported.
Cloudera Runtime 7.1.6 or Cloudera Runtime 7.1.7 Cloudera Runtime 7.1.7 SP1 Upgrades from either Cloudera Runtime 7.1.6 or Cloudera Runtime 7.1.7 are supported.
Legacy in-place upgrades (CDH and HDP to CDP Private Cloud Base 7.1.7)
Source legacy platform Target platform For step-by-step procedures, refer to Dell EMC documentation
CDH 6 CDP Private Cloud Base 7.1.7 PowerScale: CDH6 to CDP Private Cloud Base upgrade process
CDH 5 CDP Private Cloud Base 7.1.7 PowerScale: CDH5 to CDP Private Cloud Base upgrade process
HDP 3 CDP Private Cloud Base 7.1.7 PowerScale: HDP3 to CDP Private Cloud Base upgrade process
HDP 2 CDP Private Cloud Base 7.1.7 PowerScale: HDP2 to CDP Private Cloud Base upgrade process
Additional configuration guidelines

  • TLS Encryption: To configure TLS for Cloudera Runtime components, use Cloudera Manager to configure Auto-TLS. For detailed instructions, see Configuring TLS Encryption for Cloudera Manager Using Auto-TLS.

  • Cloudera Data Catalog: Cloudera Data Catalog for Cloudera Base on premises supports the Dell EMC PowerScale filesystem only when configured with HTTPS.