Understanding NiFi Record Based Processing

The RecordReader and RecordWriter Controller Services and Processors that allow you convert events from one type (json, xml, csv, Avro) to another (json, xml, csv, Avro). These controller services use the Schema Registry to fetch the schema for the event to do this conversion.

NiFi includes the following RecordReader and RecordWriter processors:
  • ConsumeKafkaRecord_0_10 1.2.0

  • ConvertRecord

  • PublishKafkaRecord_0_10

  • PutDatabaseRecord

  • QueryRecord

  • SplitRecord

NiFi also includes the following Record based Controller Services:

  • HortonworksSchemaRegistry

  • AvroRecordSetWriter

  • CSVRecordSetWriter

  • FreeFormTextRecordSetWriter

  • JsonRecordSetWriter

  • ScriptedRecordSetWriter