Receive messages encoded using the Elasticsearch Beats protocol and write decoded JSON
beats, logstash, elasticsearch, log
In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|---|---|---|---|
| Local Network Interface | Local Network Interface | The name of a local network interface to be used to restrict listening to a specific LAN. Supports Expression Language: true (will be evaluated using variable registry only) | ||
| Port | Port | The port to listen on for communication. Supports Expression Language: true (will be evaluated using variable registry only) | ||
| Receive Buffer Size | Receive Buffer Size | 65507 B | The size of each buffer used to receive messages. Adjust this value appropriately based on the expected size of the incoming messages. | |
| Max Size of Message Queue | Max Size of Message Queue | 10000 | The maximum size of the internal queue used to buffer messages being transferred from the underlying channel to the processor. Setting this value higher allows more messages to be buffered in memory during surges of incoming messages, but increases the total memory used by the processor during these surges. | |
| Max Size of Socket Buffer | Max Size of Socket Buffer | 1 MB | The maximum size of the socket buffer that should be used. This is a suggestion to the Operating System to indicate how big the socket buffer should be. If this value is set too low, the buffer may fill up before the data can be read, and incoming data will be dropped. | |
| Character Set | Character Set | UTF-8 | Specifies the character set of the received data. | |
| Max Batch Size | Max Batch Size | 1 | The maximum number of messages to add to a single FlowFile. If multiple messages are available, they will be concatenated along with the <Message Delimiter> up to this configured maximum number of messages | |
| Batching Message Delimiter | Message Delimiter | \n | Specifies the delimiter to place between messages when multiple messages are bundled together (see <Max Batch Size> property). | |
| Max Number of Worker Threads | Max Number of TCP Connections | 2 | The maximum number of worker threads available for servicing TCP connections. | |
| SSL Context Service | SSL_CONTEXT_SERVICE | Controller Service API: RestrictedSSLContextService Implementation: StandardRestrictedSSLContextService | SSL Context Service is required to enable TLS for socket connections | |
| Client Authentication | Client Auth | REQUIRED |
| Client authentication policy when TLS is enabled This Property is only considered if the [SSL Context Service] Property has a value specified. |
| Name | Description |
|---|---|
| success | Messages received successfully will be sent out this relationship. |
| Name | Description |
|---|---|
| beats.sender | Internet Protocol address of the message sender |
| beats.port | TCP port on which the Processor received messages |
| beats.sequencenumber | The sequence number of the message included for batches containing single messages |
| mime.type | The mime.type of the content which is application/json |