Reference credentials for clients using the Amazon S3 service

If you are not using IAM authentication, you need to use one of three options to provide Amazon S3 credentials to client.

If you have selected IAM authentication, no additional steps are needed
  • Programmatic - Specify the credentials in the configuration for the job. This option is most useful for Spark jobs.
  • Make a modified copy of the configuration files - Make a copy of the configuration files and add the S3 credentials.
  • Reference the managed configuration files and add AWS credentials - This option allows you to continue to use the configuration files managed by Cloudera Manager.