You can initiate a Data Lake upgrade with the CDP CLI. Using the same CLI command,
you can also search for and validate available images to upgrade to, and generate JSON templates
for specific upgrade scenarios.
Obtain image ID
If your Data Lake upgrade includes upgrading from CentOS to RHEL 8, prior to attempting an
upgrade you need to obtain an ID of a target RHEL 8 image. You can obtain it from the image
catalog by finding an image with your target Runtime version which has an OS Type of
RHEL8.
Once you have identified the ID, you can provide it in the upgrade CLI command by using the
--image-id flag.
Upgrade steps
Run the cdp datalake upgrade-datalake command. In
order to use this command for upgrading from CentOS to RHEL, ensure to provide an image ID
of a RHEL 8 image.
Required. The name or CRN of the Data Lake to upgrade.
--image-id (string)
The ID of an image to upgrade to. If upgrading from CentOS to RHEL, make sure to provide
an image ID of a target RHEL image.
--runtime (string)
The Runtime version to upgrade to. When you specify the Runtime version,
the upgrade uses the latest image ID of the given Runtime version from the same
image catalog used for Data Lake creation.
Use --lock components to perform an OS upgrade only.
--dry-run | --no-dry-run (boolean)
Checks the eligibility of an image to upgrade. Can be used in conjunction
with any other parameter, returning the available image (with respect to image Id,
Runtime or lock-components set) without performing any actions.
Skips the backup of the databases backing HMS/Ranger services. Redundant if
–skip-backup is included. If this option is not provided, the HMS/Ranger services
are backed up by default.
--skip-atlas-metadata | --no-skip-atlas-metadata
Skips the backup of the Atlas metadata. Redundant if –skip-backup is
included. If this option is not provided, the Atlas metadata is backed up by
default.
--skip-ranger-audits | --no-skip-ranger-audits
Skips the backup of the Ranger audits. Redundant if –skip-backup is
included. If this option is not provided, Ranger audits are backed up by
default.
Skips the validation steps that run prior to the backup. Redundant if
–skip-backup is included. If this option is not provided, the validations are
performed by default.
--cli-input-json (string)
Performs service operation based on the JSON string provided. The JSON
string follows the format provided by --generate-cli-skeleton. If other arguments
are provided on the command line, the CLI values will override the JSON-provided
values.
--generate-cli-skeleton (boolean)
Prints a sample input JSON to standard output. Note the specified operation
is not run if this argument is specified. The sample input can be used as an
argument for --cli-input-json.
When you run the cdp datalake upgrade-datalake command to initiate an
upgrade, you have one of three options:
Specify one of either --image-id,
--runtime, or --lockComponents, which makes an
explicit choice of the exact image, Runtime (latest OS), or latest OS (same Runtime)
for upgrade.
Specify both--image-id and --lockComponents, which specifies
an image and ensures the image represents an OS only upgrade.
Specify none of the --image-id,
--runtime, or --lockComponents parameters, which
initiates a Runtime/CM upgrade to the latest compatible version and OS image.
Outside of upgrade, you can use the following options:
