Cloud storage

Access from Data Hub cluster to cloud storage is optionally configured on environment level.

During environment creation, you configure S3 as default storage for that environment. All Data Hub clusters created within that environment can access S3 based on the level of access defined via IDBroker mappings.

Furthermore, S3Guard is enabled on environment level. S3Guard mitigates the issues related to S3's eventual consistency on listings by using a table on Amazon DynamoDB as a consistent metadata store. This guarantees a consistent view of data stored in S3.