Performing dry run and manually running the Cloudera Lakehouse Optimizer policies in Lakehouse Optimizer UI
In Cloudera on cloud 7.3.2 and higher versions, dry run Cloudera Lakehouse Optimizer policies to preview generated maintenance tasks and verify expected outcomes before initiating a manual or scheduled execution.
- Go to the Cloudera Management Console > Lakehouse Optimizer page.
-
Select one of the following methods to open the Dry Run and
Execution side panel:
- Click
for a table on the Table
Associations tab, and then click the Dry Run
& Execute action. - Click
for a table on the Table
Associations tab, and then click the View
Policy action. On the View Policy page,
click
for a table, and then click the Dry
Run & Execute action.
- Click
-
Select one of the following options depending on your use case:
- Dry Run Only –- This option generates the
maintenance tasks for the table, and performs a dry run to ensure they run
without failure. No action is performed on the table.
After you choose this option, Cloudera Lakehouse Optimizer initiates the dry run of the policy during which it fetches and evaluates the policy definition on the table to generate the maintenance actions. The output is provided in the side panel in JSON format.
Click JSON Details to view the output. Optionally, you can copy the JSON details, and save these details in a file on your machine for future reference. After reviewing the generated output, you can decide whether to run the policy on the table, or to modify the policy to meet your requirements. You can close the side panel after the dry run is complete or cancelled.
- Dry Run & Execute –- This option performs a
dry run and allows you to execute the policy immediately after reviewing the results.
- After you click Dry Run & Execute, Cloudera Lakehouse Optimizer generates the maintenance tasks and initiates a dry run, providing the output in the side panel. Click JSON Details to view the output.
- After you review the output, click Execute Table Policy. Cloudera Lakehouse Optimizer then initiates the policy run and displays the run details, which include the policy run status, task ID, and task details.
- Optionally, you can click See All Recent Task Activity to view more details about the policy run."
- Dry Run Only –- This option generates the
maintenance tasks for the table, and performs a dry run to ensure they run
without failure. No action is performed on the table.
- Click Done to close the side panel.
