Writes the contents of a FlowFile as an S3 Object to an Amazon S3 Bucket.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|
| Bucket | Bucket | ${s3.bucket} | | The S3 Bucket to interact with
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Object Key | Object Key | ${filename} | | The S3 Object Key to use. This is analogous to a filename for traditional file systems.
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Region | Region | US West (Oregon) | - AWS GovCloud (US)
 - AWS GovCloud (US-East)
- US East (N. Virginia)
- US East (Ohio)
- US West (N. California)
- US West (Oregon)
- EU (Ireland)
- EU (London)
- EU (Paris)
- EU (Frankfurt)
- EU (Zurich)
- EU (Stockholm)
- EU (Milan)
- EU (Spain)
- Asia Pacific (Hong Kong)
- Asia Pacific (Mumbai)
- Asia Pacific (Hyderabad)
- Asia Pacific (Singapore)
- Asia Pacific (Sydney)
- Asia Pacific (Jakarta)
- Asia Pacific (Melbourne)
- Asia Pacific (Tokyo)
- Asia Pacific (Seoul)
- Asia Pacific (Osaka)
- South America (Sao Paulo)
- China (Beijing)
- China (Ningxia)
- Canada (Central)
- Canada West (Calgary)
- Middle East (UAE)
- Middle East (Bahrain)
- Africa (Cape Town)
- US ISO East
- US ISOB East (Ohio)
- US ISO West
- Israel (Tel Aviv)
- Use 's3.region' Attribute
| The AWS Region to connect to. |
| AWS Credentials Provider Service | AWS Credentials Provider service | | Controller Service API:
AWSCredentialsProviderService
Implementations: AWSIDBrokerCloudCredentialsProviderControllerService
AWSCredentialsProviderControllerService | The Controller Service that is used to obtain AWS credentials provider |
| Storage Class | Storage Class | Standard | - DeepArchive
- Glacier
- GlacierInstantRetrieval
- IntelligentTiering
- OneZoneInfrequentAccess
- Outposts
- ReducedRedundancy
- Snow
- Standard
- StandardInfrequentAccess
| No description provided. |
| Encryption Service | encryption-service | | Controller Service API:
AmazonS3EncryptionService
Implementation: StandardS3EncryptionService | Specifies the Encryption Service Controller used to configure requests. PutS3Object: For backward compatibility, this value is ignored when 'Server Side Encryption' is set. FetchS3Object: Only needs to be configured in case of Server-side Customer Key, Client-side KMS and Client-side Customer Key encryptions. |
| Server Side Encryption | server-side-encryption | None | | Specifies the algorithm used for server side encryption. |
| Content Type | Content Type | | | Sets the Content-Type HTTP header indicating the type of content stored in the associated object. The value of this header is a standard MIME type.
AWS S3 Java client will attempt to determine the correct content type if one hasn't been set yet. Users are responsible for ensuring a suitable content type is set when uploading streams. If no content type is provided and cannot be determined by the filename, the default content type "application/octet-stream" will be used.
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Content Disposition | Content Disposition | | | Sets the Content-Disposition HTTP header indicating if the content is intended to be displayed inline or should be downloaded.
Possible values are 'inline' or 'attachment'. If this property is not specified, object's content-disposition will be set to filename. When 'attachment' is selected, '; filename=' plus object key are automatically appended to form final value 'attachment; filename="filename.jpg"'. |
| Cache Control | Cache Control | | | Sets the Cache-Control HTTP header indicating the caching directives of the associated object. Multiple directives are comma-separated.
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Object Tags Prefix | s3-object-tags-prefix | | | Specifies the prefix which would be scanned against the incoming FlowFile's attributes and the matching attribute's name and value would be considered as the outgoing S3 object's Tag name and Tag value respectively. For Ex: If the incoming FlowFile carries the attributes tagS3country, tagS3PII, the tag prefix to be specified would be 'tagS3'
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Remove Tag Prefix | s3-object-remove-tags-prefix | False | | If set to 'True', the value provided for 'Object Tags Prefix' will be removed from the attribute(s) and then considered as the Tag name. For ex: If the incoming FlowFile carries the attributes tagS3country, tagS3PII and the prefix is set to 'tagS3' then the corresponding tag values would be 'country' and 'PII' |
| Communications Timeout | Communications Timeout | 30 secs | | The amount of time to wait in order to establish a connection to AWS or receive data from AWS before timing out. |
| Expiration Time Rule | Expiration Time Rule | | | No description provided.
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| FullControl User List | FullControl User List | ${s3.permissions.full.users} | | A comma-separated list of Amazon User ID's or E-mail addresses that specifies who should have Full Control for an object
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Read Permission User List | Read Permission User List | ${s3.permissions.read.users} | | A comma-separated list of Amazon User ID's or E-mail addresses that specifies who should have Read Access for an object
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Write Permission User List | Write Permission User List | ${s3.permissions.write.users} | | A comma-separated list of Amazon User ID's or E-mail addresses that specifies who should have Write Access for an object
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Read ACL User List | Read ACL User List | ${s3.permissions.readacl.users} | | A comma-separated list of Amazon User ID's or E-mail addresses that specifies who should have permissions to read the Access Control List for an object
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Write ACL User List | Write ACL User List | ${s3.permissions.writeacl.users} | | A comma-separated list of Amazon User ID's or E-mail addresses that specifies who should have permissions to change the Access Control List for an object
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Owner | Owner | ${s3.owner} | | The Amazon ID to use for the object's owner
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| Canned ACL | canned-acl | ${s3.permissions.cannedacl} | | Amazon Canned ACL for an object, one of: BucketOwnerFullControl, BucketOwnerRead, LogDeliveryWrite, AuthenticatedRead, PublicReadWrite, PublicRead, Private; will be ignored if any other ACL/permission/owner property is specified
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables) |
| SSL Context Service | SSL Context Service | | Controller Service API:
SSLContextService
Implementations: StandardRestrictedSSLContextService
StandardSSLContextService | Specifies an optional SSL Context Service that, if provided, will be used to create connections |
| Endpoint Override URL | Endpoint Override URL | | | Endpoint URL to use instead of the AWS default including scheme, host, port, and path. The AWS libraries select an endpoint URL based on the AWS region, but this property overrides the selected endpoint URL, allowing use with other S3-compatible endpoints.
Supports Expression Language: true (will be evaluated using Environment variables only) |
| Signer Override | Signer Override | Default Signature | - Default Signature
- Signature Version 4
- Signature Version 2
- Custom Signature
| The AWS S3 library uses Signature Version 4 by default but this property allows you to specify the Version 2 signer to support older S3-compatible services or even to plug in your own custom signer implementation. |
| Custom Signer Class Name | custom-signer-class-name | | | Fully qualified class name of the custom signer class. The signer must implement com.amazonaws.auth.Signer interface.
Supports Expression Language: true (will be evaluated using Environment variables only)
This Property is only considered if the [Signer Override] Property has a value of "Custom Signature". |
| Custom Signer Module Location | custom-signer-module-location | | | Comma-separated list of paths to files and/or directories which contain the custom signer's JAR file and its dependencies (if any).
This property expects a comma-separated list of resources. Each of the resources may be of any of the following types: directory, file.
Supports Expression Language: true (will be evaluated using Environment variables only)
This Property is only considered if the [Signer Override] Property has a value of "Custom Signature". |
| Multipart Threshold | Multipart Threshold | 5 GB | | Specifies the file size threshold for switch from the PutS3Object API to the PutS3MultipartUpload API. Flow files bigger than this limit will be sent using the stateful multipart process. The valid range is 50MB to 5GB. |
| Multipart Part Size | Multipart Part Size | 5 GB | | Specifies the part size for use when the PutS3Multipart Upload API is used. Flow files will be broken into chunks of this size for the upload process, but the last part sent can be smaller since it is not padded. The valid range is 50MB to 5GB. |
| Multipart Upload AgeOff Interval | Multipart Upload AgeOff Interval | 60 min | | Specifies the interval at which existing multipart uploads in AWS S3 will be evaluated for ageoff. When processor is triggered it will initiate the ageoff evaluation if this interval has been exceeded. |
| Multipart Upload Max Age Threshold | Multipart Upload Max Age Threshold | 7 days | | Specifies the maximum age for existing multipart uploads in AWS S3. When the ageoff process occurs, any upload older than this threshold will be aborted. |
| Temporary Directory Multipart State | s3-temporary-directory-multipart | ${java.io.tmpdir} | | Directory in which, for multipart uploads, the processor will locally save the state tracking the upload ID and parts uploaded which must both be provided to complete the upload.
Supports Expression Language: true (will be evaluated using Environment variables only) |
| Use Chunked Encoding | use-chunked-encoding | true | | Enables / disables chunked encoding for upload requests. Set it to false only if your endpoint does not support chunked uploading. |
| Use Path Style Access | use-path-style-access | false | | Path-style access can be enforced by setting this property to true. Set it to true if your endpoint does not support virtual-hosted-style requests, only path-style requests. |
| Proxy Configuration Service | proxy-configuration-service | | Controller Service API:
ProxyConfigurationService
Implementation: StandardProxyConfigurationService | Specifies the Proxy Configuration Controller Service to proxy network requests. |
Dynamic Properties allow the user to specify both the name and value of a property.