ConvertAvroSchema

Description:

Convert records from one Avro schema to another, including support for flattening and simple type conversions

Additional Details...

Tags:

avro, convert, kite

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

Display NameAPI NameDefault ValueAllowable ValuesDescription
Input SchemaInput SchemaAvro Schema of Input Flowfiles. This can be a URI (dataset, view, or resource) or literal JSON schema.
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
Output SchemaOutput SchemaAvro Schema of Output Flowfiles. This can be a URI (dataset, view, or resource) or literal JSON schema.
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
LocaleLocaledefaultLocale to use for scanning data (see https://docs.oracle.com/javase/7/docs/api/java/util/Locale.html)or " default" for JVM default
Compression typekite-compression-typeSNAPPY
  • BZIP2
  • DEFLATE
  • NONE
  • SNAPPY
  • LZO
Compression type to use when writting Avro files. Default is Snappy.
Hadoop configuration ResourcesHadoop configuration filesA file or comma separated list of files which contains the Hadoop file system configuration. Without this, Hadoop will search the classpath for a 'core-site.xml' and 'hdfs-site.xml' file or will revert to a default configuration.

This property expects a comma-separated list of file resources.

Supports Expression Language: true (will be evaluated using variable registry only)

Dynamic Properties:

Supports Sensitive Dynamic Properties: No

Dynamic Properties allow the user to specify both the name and value of a property.

NameValueDescription
Field name from input schemaField name for output schemaExplicit mappings from input schema to output schema, which supports renaming fields and stepping into nested records on the input schema using notation like parent.id
Supports Expression Language: false

Relationships:

NameDescription
successAvro content that converted successfully
failureAvro content that failed to convert

Reads Attributes:

None specified.

Writes Attributes:

None specified.

State management:

This component does not store state.

Restricted:

This component is not restricted.

Input requirement:

This component requires an incoming relationship.

System Resource Considerations:

None specified.