Scribd
Upload
24 views11 pages

Hadoop 2.x Installation Steps

The document outlines the steps to install Hadoop 2.6.0, including downloading the version from Apache mirrors, creating a work directory, configuring configuration files like core-site.xml and hdfs-site.xml, updating environment variables in files like hadoop-env.sh to set the JAVA_HOME path, formatting the namenode, and starting Hadoop processes with the start-all.sh command.

Uploaded by

Venkat Gowda
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
24 views11 pages

Hadoop 2.x Installation Steps

The document outlines the steps to install Hadoop 2.6.0, including downloading the version from Apache mirrors, creating a work directory, configuring configuration files like core-site.xml and hdfs-site.xml, updating environment variables in files like hadoop-env.sh to set the JAVA_HOME path, formatting the namenode, and starting Hadoop processes with the start-all.sh command.

Uploaded by

Venkat Gowda
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 11

Hadoop-2.6.

0 Version Installation Steps:


1. Download the hadoop-2.6.0
2.6.0 version from Apache Mirrors
2. Create the work directory in orienit user, path is `/home/orienit
/home/orienit`
3. Please follow the below screen shot steps.

4. These 8 files contains the proper content for hadoop-2


hadoop 2.6.0
configuration.

5. Follow the below screen shot steps.

Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
6. Open the core-site.xml
site.xml file , this file having two properties and
understand the two properties information.

7. Open the hadoop-env.sh


env.sh file and update the JAVA_HOME path.

8. Open the hdfs-site.xml


site.xml file and follow the below properties
information.

Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
9. Open the mapred-env.sh
env.sh and update the JAVA_HOME path

10. Open the mapred-site.xml,


mapred , this file contains valu
value as to pointing
to the yarn architecture

Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
11. Open the yarn-env.sh
env.sh and update the JAVA_HOME path.

12. Open the yarn-site.xml


site.xml and this file contains two properties for
to configure the ResourceManager, NodeManager.

Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
13. When we install hadoop-2.6.0
hadoop in pseudo
o mode , then in slaves file
we will write only localhost

14. When we install hadoop in cluster mode, then in slaves file we will
update all systems ip address / hostnames

15. Open the ~/.bashrc


bashrc file and update the hadoop--2.6.0 related
information.
export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk
JAVA_HOME=/usr/lib/jvm/java
export HADOOP_HOME=/home/orienit/work/hadoop-2.6.0
HADOOP_HOME=/home/orienit/work/hadoop
export PATH=$HADOOP_HOME/bin: =$HADOOP_HOME/sbin:$JAVA_HOME/bin:$PATH

Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
16. If we want confirm the all configuration files are updated or not
then verify with below command

17. Execute the NameNode format command


(hadoop namenode -format)
format)

18. When we execute format command then the NameNode


information displayed on console, verify the below screen shot.

Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
19. Start the hadoop--2.6.0 using “start-all.sh” Command
ommand
(Observe
rve the all process names of hadoop-2.6.0
hadoop 2.6.0 on console.
console.)

Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad, ORIEN IT @ 040-65142345, 9703202345
Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad, ORIEN IT @ 040-65142345, 9703202345
Mr. Kalyan, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad, ORIEN IT @ 040-65142345, 9703202345

You might also like