Parser Configuration

The configuration for the various parser topologies is defined by JSON documents stored in ZooKeeper.

The JSON document consists of the following attributes:

The fully qualified class name for the parser to be used.


The Kafka topic to send the parsed messages to.


A JSON Map representing the parser implementation specific configuration.


An array of complex objects representing the transformations to be done on the message generated from the parser before writing out to the Kafka topic.

The fieldTransformations is a complex object which defines a transformation that can be done to a message. This transformation can perform the following:

  • Modify existing fields to a message

  • Add new fields given the values of existing fields of a message

  • Remove existing fields of a message