Disabling S3Guard and destroying a table
To disable S3Guard, you must delete the per-bucket
fs.s3a.metadatastore.impl
parameter or set it back to the default
org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
.
If you are not using a shared table, in DynamoDB console on AWS, delete the DynamoDB table to avoid incurring unnecessary costs.
Destroying S3Guard table
The command hadoop s3guard destroy
can be used on the command line to
destroy a table.
hadoop s3guard destroy s3a://guarded-table/ 2018-05-31 15:35:39,075 [main] INFO s3guard.S3GuardTool (S3GuardTool.java:initMetadataStore(270)) - Metadata store DynamoDBMetadataStore{region=eu-west-1, tableName=guarded-table} is initialized. 2018-05-31 15:35:39,077 [main] INFO s3guard.DynamoDBMetadataStore (DynamoDBMetadataStore.java:destroy(793)) - Deleting DynamoDB table guarded-table in region eu-west-1 Metadata store is deleted.
Destroying a table does not destroy the data in S3; it merely removes the summary
data used by S3Guard to provide consistent listings. You can verify this by listing the
bucket:
> hadoop fs -ls -R s3a://guarded-table/
-rw-rw-rw- 1 alice alice 0 2019-07-31 20:45 s3a://guarded-table/example