Minimal setup for AWS cloud storage
This minimal secure setup uses one S3 bucket for each Data Lake, and multiple IAM roles and policies.
The example setup includes:
- One S3 bucket with a sub-directory named after your data lake, such as s3a://my-bucket/my-dl.
- One IAM role and one instance profile:
- LOG_ROLE role and instance profile.
- Four IAM policies:
- A shared policy for accessing S3:
aws-cdp-bucket-access-policy
- Two policies for specific bucket directory access:
- Log storage (
aws-cdp-log-policy) - (Optional) FreeIPA backup storage - if using a separate bucket
(
aws-cdp-backup-policy)
- Log storage (
- One trust policies:
aws-cdp-ec2-role-trust-policy
- A shared policy for accessing S3:
