Hortonworks Docs » DataFlow 3.5.1 » Integrating with Schema Registry

Integrating with Schema Registry

Also available as:

PDF

loading table of contents...

Integrating with NiFi
Integrating with Kafka
- Integrating Kafka and Schema Registry Using NiFi Processors
- Integrating Kafka and Schema Registry
Integrating with Stream Analytics Manager

Integrating with NiFi

Understanding NiFi Record Based Processing
The RecordReader and RecordWriter Controller Services and Processors that allow you convert events from one type (json, xml, csv, Avro) to another (json, xml, csv, Avro). These controller services use the Schema Registry to fetch the schema for the event to do this conversion.
Setting up the HortonworksSchemaRegistry Controller Service
To configure Schema Registry to communicate with NiFi dataflows, the first thing you must do is tell NiFi about the Schema Registry instance with which you want to communicate. You do this from the NiFi UI, using the HortonworksSchemaRegistry Controller Service.
Adding and Configuring Record Reader and Writer Controller Services
NiFi provides Record Reader and Writer Controller Services to support record-based processing. These Controller Services are new services that allows you convert events from one type (JSON, XML, CSV, Avro) to another. These Controller Services use the Schema Registry to fetch the schema for the event to do this conversion. Before using these new Controller Services, you must configure them for use with Schema Registry.
Using Record-Enabled Processors
Record-enabled Processors allow you to use convert data between formats by specifying Controller Services for record reading and record writing. This streamlines your dataflows and inproves overall performance.

© 2012–2020, Cloudera, Inc.

Document licensed under the Creative Commons Attribution ShareAlike 4.0 License.

Cloudera.com | Documentation | Support | Community