BIG DATA: FLUME INSTALLATION

FLUME INSTALLATION

Step 1: Download latest Flume release from Apache Website.

Step 2: Move/Copy it to the location you want to install, in my case it is “/usr/local/”.

1.$cd Downloads/ 2.$sudo cp apache-flume-1.6.0-bin.tar.gz /usr/local/

Step 3: Extract the tar file. Go to the copied folder, in my case it is “/usr/local/” , run the below commands

$ cd /usr/local
$ sudo tar -xzvf apache-flume-1.6.0-bin.tar.gz

Step 4: Rename folder from “apache-flume-1.6.0-bin” to “flume” for simplicity.

$ sudo mv apache-flume-1.6.0-bin flume

Step 5: Update environments

$ gedit ~/.bashrc

⇸Add Below Lines:

export FLUME_HOME=/usr/local/flume

export FLUME_CONF_DIR=$FLUME_HOME/conf

export FLUME_CLASSPATH=$FLUME_CONF_DIR

export PATH=$PATH:$FLUME_HOME/bin

Step 6: Change owner to user and group, in my case it is user:hduser and group:hadoop

$ sudo chown -R hduser:hadoop /usr/local/flume

Step 7: Rename “flume-env.sh.template” to “flume-env.sh” and write the below values.

$ sudo mv /usr/local/flume/conf/flume-env.sh.template flume-env.sh

$ gedit /usr/local/flume/conf/flume-env.sh

Add below line(please use your installed java version)

$JAVA_OPTS="-Xms500m -Xmx1000m -Dcom.sun.management.jmxremote"
export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64

How to check java version:

echo $JAVA_HOME

Step 8: Enter as hduser and run flume CLI:

$ flume-ng --help