Administration
Also available as:
PDF
loading table of contents...

Running the Enrichment Loader

After the enrichment source and enrichment configuration are defined, you must run the loader to move the data from the enrichment source to the HCP enrichment store and store the enrichment configuration in ZooKeeper.

  1. Use the loader to move the enrichment source to the enrichment store in ZooKeeper:

    $METRON_HOME/bin/flatfile_loader.sh -n enrichment_config.json -i whois_ref.csv -t enrichment -c t -e extractor_config.json

    HCP loads the enrichment data into Apache HBase and establishes a ZooKeeper mapping. The data is extracted using the extractor and configuration defined in the extractor_config.json file and populated into an HBase table called enrichment.

  2. Verify that the logs were properly ingested into HBase:

    hbase shell
    scan 'enrichment'
    
  3. Verify that the ZooKeeper enrichment tag was properly populated:

    $METRON_HOME/bin/zk_load_configs.sh -m DUMP -z $ZOOKEEPER_HOST:2181
  4. Generate some data by using a client for your particular data source to execute requests.