Queries Solr and outputs the results as a FlowFile in the format of XML or using a Record Writer
Apache, Solr, Get, Pull, Records
In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
Display Name | API Name | Default Value | Allowable Values | Description |
---|---|---|---|---|
Solr Type | Solr Type | Standard |
| The type of Solr instance, Cloud or Standard. |
Solr Location | Solr Location | The Solr url for a Solr Type of Standard (ex: http://localhost:8984/solr/gettingstarted), or the ZooKeeper hosts for a Solr Type of Cloud (ex: localhost:9983). Supports Expression Language: true (will be evaluated using variable registry only) | ||
Collection | Collection | The Solr collection name, only used with a Solr Type of Cloud Supports Expression Language: true (will be evaluated using variable registry only) | ||
Return Type | Return Type | XML |
| Write Solr documents to FlowFiles as XML or using a Record Writer |
Record Writer | Record Writer | Controller Service API: RecordSetWriterFactory Implementations: RecordSetWriterLookup ScriptedRecordSetWriter JsonRecordSetWriter AvroRecordSetWriter CSVRecordSetWriter ParquetRecordSetWriter XMLRecordSetWriter FreeFormTextRecordSetWriter | The Record Writer to use in order to write Solr documents to FlowFiles. Must be set if "Records" is used as return type. Supports Expression Language: true (will be evaluated using variable registry only) | |
Solr Query | Solr Query | A query to execute against Solr | ||
Date Field | Date Field | The name of a date field in Solr used to filter results | ||
Initial Date Filter | Initial Date Filter | Date value to filter results. Documents with an earlier date will not be fetched. The format has to correspond to the date pattern of Solr 'YYYY-MM-DDThh:mm:ssZ' | ||
Return Fields | Return Fields | Comma-separated list of field names to return | ||
Batch Size | Batch Size | 100 | Number of rows per Solr query | |
Kerberos Credentials Service | kerberos-credentials-service | Controller Service API: KerberosCredentialsService Implementation: KeytabCredentialsService | Specifies the Kerberos Credentials Controller Service that should be used for authenticating with Kerberos | |
Kerberos User Service | kerberos-user-service | Controller Service API: KerberosUserService Implementations: KerberosTicketCacheUserService KerberosKeytabUserService KerberosPasswordUserService | Specifies the Kerberos User Controller Service that should be used for authenticating with Kerberos | |
Kerberos Principal | kerberos-principal | The principal to use when specifying the principal and password directly in the processor for authenticating to Solr via Kerberos. Supports Expression Language: true (will be evaluated using variable registry only) | ||
Kerberos Password | kerberos-password | The password to use when specifying the principal and password directly in the processor for authenticating to Solr via Kerberos. Sensitive Property: true | ||
Basic Auth Username | Username | The username to use when Solr is configured with basic authentication. Supports Expression Language: true (will be evaluated using variable registry only) | ||
Basic Auth Password | Password | The password to use when Solr is configured with basic authentication. Sensitive Property: true Supports Expression Language: true (will be evaluated using variable registry only) | ||
SSL Context Service | SSL Context Service | Controller Service API: SSLContextService Implementations: StandardRestrictedSSLContextService StandardSSLContextService | The Controller Service to use in order to obtain an SSL Context. This property must be set when communicating with a Solr over https. | |
Solr Socket Timeout | Solr Socket Timeout | 10 seconds | The amount of time to wait for data on a socket connection to Solr. A value of 0 indicates an infinite timeout. | |
Solr Connection Timeout | Solr Connection Timeout | 10 seconds | The amount of time to wait when establishing a connection to Solr. A value of 0 indicates an infinite timeout. | |
Solr Maximum Connections | Solr Maximum Connections | 10 | The maximum number of total connections allowed from the Solr client to Solr. | |
Solr Maximum Connections Per Host | Solr Maximum Connections Per Host | 5 | The maximum number of connections allowed from the Solr client to a single Solr host. | |
ZooKeeper Client Timeout | ZooKeeper Client Timeout | 10 seconds | The amount of time to wait for data on a connection to ZooKeeper, only used with a Solr Type of Cloud. | |
ZooKeeper Connection Timeout | ZooKeeper Connection Timeout | 10 seconds | The amount of time to wait when establishing a connection to ZooKeeper, only used with a Solr Type of Cloud. |
Name | Description |
---|---|
success | The results of querying Solr |
Scope | Description |
---|---|
CLUSTER | Stores latest date of Date Field so that the same data will not be fetched multiple times. |