DSS Administration
Also available as:
PDF

Edit Profiler Configuration

In addition to turning on and off the profiler configurations, the individual profilers can be run with their own execution parameters. These parameters are for submission of the profiler job onto Spark. You can edit the configuration of profilers and update these parameters to run profiler jobs.

  1. Click Profilers in the main navigation menu on the left.
  2. Click Configs to view all of configured profilers.
  3. Select the cluster for which you need to edit profiler configuration.

    The list of profilers for the selected clusters is displayed.

  4. Click the name of the profiler whose configuration you wish to edit.

    The Profiler Configuration tab is displayed in the right panel.

  5. Select the queue from the drop down list.
  6. Select a schedule to run the profiler. This is implemented as a quartz cron expression.
  7. Update the advanced options.
    • Number of Executors - Enter the number of executors to launch for running this profiler.
    • Executor Cores - Enter the number of cores to be used for each executor.
    • Executor Memory - Enter the amount of memory in GB to be used per executor process.
    • Driver Cores - Enter the number of cores to be used for the driver process.
    • Driver Memory - Enter the memory to be used for the driver processes.
  8. Toggle the state of the profiler from Active to Inactive as needed.
  9. Click Save to apply the configuration changes to the selected profiler. The changes should appear in the profiler description.