Upgrading HDP Manually
Also available as:
PDF
loading table of contents...

Configure, Start, and Validate Apache Flume

Upgrade Apache Flume. On the Flume host machine, run the following command:

  • For RHEL/CentOS/Oracle Linux:

    yum upgrade flume

  • For SLES:

    zypper update flume

    zypper remove flume

    zypper se -s flume

    You should see Flume in the output.

    Install Flume:

    zypper install flume

  • For Ubuntu/Debian:

    apt-get install flume

Replace your configuration after upgrading. Copy /etc/flume/conf from the template to the conf directory in Flume hosts.

By default on installation Flume does not start running immediately. To validate, replace your default conf/flume.conf with the provided flume.conf file, and restart Flume. See if the data is flowing by examining the destination.

Use this flume.conf file:

1. Name the components on this agent 
a1.sources = r1
a1.sinks = k1 
a1.channels = c1

2. Describe/configure the source 
a1.sources.r1.type = seq

3. Describe the sink 
a1.sinks.k1.type = file_roll 
a1.sinks.k1.channel = c1
a1.sinks.k1.sink.directory = /tmp/flume

4. Use a channel which buffers events in memory 
a1.channels.c1.type = memory

5. Bind the source and sink to the channel 
a1.sources.r1.channels = c1 
a1.sinks.k1.channel = c1

After starting Flume, check /tmp/flume to see if there are any files there. The files should contain simple sequential numbers.

After validating, stop Flume and revert changes to flume.conf to prevent your disk from filling up.