Understanding NiFi Record Based Processing

The RecordReader and RecordWriter Controller Services and Processors that allow you convert events from one type (json, xml, csv, Avro) to another (json, xml, csv, Avro). These controller services use the Schema Registry to fetch the schema for the event to do this conversion.

NiFi includes the following RecordReader and RecordWriter processors:
  • ConsumeKafkaRecord_0_10 1.2.0

  • ConvertRecord

  • PublishKafkaRecord_0_10

  • PutDatabaseRecord

  • QueryRecord

  • SplitRecord

NiFi also includes the following Record based Controller Services:

  • HortonworksSchemaRegistry

  • AvroRecordSetWriter

  • CSVRecordSetWriter

  • FreeFormTextRecordSetWriter

  • JsonRecordSetWriter

  • ScriptedRecordSetWriter

More Information

HCC Article on Apache NiFi record based processing