Installing Cloudera (CDH 5 ) on Centos Linux.

In this article we will be discussing about Installing Cloudera (CDH 5 ) in Centos Linux.

Ways To Install CDH 5 :-

We can install CDH 5 in following ways:

• Automated ways: Using Cloudera Manager, This is recommended method to install cloudera.
• Manual ways. Using Cloudera repository.

Here we are going to install CDH 5 using manual method ( using Cloudera repository).

Visit this link to download repository of cloudera:

http://www.cloudera.com/documentation/cdh/5-0-x/CDH5-Installation-Guide/cdh5ig_cdh5_install.html#topic_4_4_1_unique_1

Download and install CDH 5 repository for your Centos System-

Here i have downloaded it for centos 64 bit.

Move to Downloads folder, and move cloudera repository to home directory.

Return back to home directory and Install the repository for centos –

Now Add a Repository Key which enables you to verify that you are downloading genuine packages. [ Optional ]

Now Install CDH 5 with YARN:

Note: Before installing YARN daemons clean yum repository.

Then install YARN –

Install hadoop-hdfs-namenode :

Secondary NameNode Installation:

Install data-nodes and other cluster hosts:

Install one history server and yarn-proxyserver :

Add below property into core-site.xml between configuration tag:

<property>

<name>fs.defaultFS</name>

<value>hdfs://acd.acadgild.net:8020</value>

</property>

Add below property into hdfs-site.xml :

<property>

    <name>dfs.namenode.name.dir</name>

    <value>file:///var/lib/hadoop-hdfs/cache/hdfs/dfs/name</value>

 </property>

<property>

<name>dfs.datanode.data.dir</name>

<value>file:///data/1/dfs/dn,file:///data/2/dfs/dn,file:///data/3/dfs/dn,file:///data/4/dfs/dn</value>

</property>

Make Namenode and Datanode directory and set permission to them –

Run following command one by one:-

• 1	sudo mkdir -p /data/1/dfs/nn /nfsmount/dfs/nn

• 1	sudo mkdir -p /data/1/dfs/dn /data/2/dfs/dn /data/3/dfs/dn /data/4/dfs/dn

• 1	sudo chown -R hdfs:hdfs /data/1/dfs/nn /nfsmount/dfs/nn /data/1/dfs/dn /data/2/dfs/dn /data/3/dfs/dn /data/4/dfs/dn

• 1	sudo chmod 700 /data/1/dfs/nn /nfsmount/dfs/nn

• 1	sudo chmod go-rx /data/1/dfs/nn /nfsmount/dfs/nn

• 1

  Reboot

Now type jps to see All running daemons

All set, Now  Cloudera Cluster has been configured and will start Automatically after every reboot.

Keep visiting our blogs :- https://acadgild.com/blog/