24/09/2018 Step by step Hadoop 2.8.

0 installation on Window 10 · MuhammadBilalYar/Hadoop-On-Window Wiki · GitHub

Dismiss
Join GitHub today
GitHub is home to over 28 million developers
working together to host and review code, manage
projects, and build software together.

Sign up

Step by step Hadoop 2.8.0 installation on

Window 10
Jump to bottom

Muhammad Bilal Yar edited this page on 24 Jun · 5 revisions

Prepare:
These softwares should be prepared to install Hadoop 2.8.0 on window 10 64bit

1. Download Hadoop 2.8.0 (Link: http://www-eu.apache.org/dist/hadoop/common/hadoop-

2.8.0/hadoop-2.8.0.tar.gz OR http://archive.apache.org/dist/hadoop/core//hadoop-
2.8.0/hadoop-2.8.0.tar.gz)
2. Java JDK 1.8.0.zip (Link: http://www.oracle.com/technetwork/java/javase/downloads/jdk8-
downloads-2133151.html)

Set up
1. Check either Java 1.8.0 is already installed on your system or not, use "Javac -version" to

check.

https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10 1/10
24/09/2018 Step by step Hadoop 2.8.0 installation on Window 10 · MuhammadBilalYar/Hadoop-On-Window Wiki · GitHub

2. If Java is not installed on your system then first install java under "C:\JAVA"

3. Extract file Hadoop 2.8.0.tar.gz or Hadoop-2.8.0.zip and place under "C:\Hadoop-2.8.0".

4. Set the path HADOOP_HOME Environment variable on windows 10(see Step 1,2,3 and 4
below).

https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10 2/10
24/09/2018 Step by step Hadoop 2.8.0 installation on Window 10 · MuhammadBilalYar/Hadoop-On-Window Wiki · GitHub

https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10 3/10
24/09/2018 Step by step Hadoop 2.8.0 installation on Window 10 · MuhammadBilalYar/Hadoop-On-Window Wiki · GitHub

5. Set the path JAVA_HOME Environment variable on windows 10(see Step 1,2,3 and 4 below).

https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10 4/10
24/09/2018 Step by step Hadoop 2.8.0 installation on Window 10 · MuhammadBilalYar/Hadoop-On-Window Wiki · GitHub

6. Next we set the Hadoop bin directory path and JAVA bin directory path.

Configuration
1. Edit file C:/Hadoop-2.8.0/etc/hadoop/core-site.xml, paste below xml paragraph and save
this file.

<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>

https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10 5/10
24/09/2018 Step by step Hadoop 2.8.0 installation on Window 10 · MuhammadBilalYar/Hadoop-On-Window Wiki · GitHub

</property>
</configuration>

2. Rename "mapred-site.xml.template" to "mapred-site.xml" and edit this file C:/Hadoop-

2.8.0/etc/hadoop/mapred-site.xml, paste below xml paragraph and save this file.

<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>

3. Create folder "data" under "C:\Hadoop-2.8.0"

Create folder "datanode" under "C:\Hadoop-2.8.0\data"

Create folder "namenode" under "C:\Hadoop-2.8.0\data"

4. Edit file C:\Hadoop-2.8.0/etc/hadoop/hdfs-site.xml, paste below xml paragraph and save

this file.

<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>C:\hadoop-2.8.0\data\namenode</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>C:\hadoop-2.8.0\data\datanode</value>
</property>
</configuration>

https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10 6/10
24/09/2018 Step by step Hadoop 2.8.0 installation on Window 10 · MuhammadBilalYar/Hadoop-On-Window Wiki · GitHub

5. Edit file C:/Hadoop-2.8.0/etc/hadoop/yarn-site.xml, paste below xml paragraph and save

this file.

<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>

6. Edit file C:/Hadoop-2.8.0/etc/hadoop/hadoop-env.cmd by closing the command line

"JAVA_HOME=%JAVA_HOME%" instead of set "JAVA_HOME=C:\Java" (On C:\java this is
path to file jdk.18.0)

Hadoop Configuration
1. Dowload file Hadoop Configuration.zip (Link:
https://github.com/MuhammadBilalYar/HADOOP-INSTALLATION-ON-WINDOW-
10/blob/master/Hadoop%20Configuration.zip)
2. Delete file bin on C:\Hadoop-2.8.0\bin, replaced by file bin on file just download (from
Hadoop Configuration.zip).

https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10 7/10
24/09/2018 Step by step Hadoop 2.8.0 installation on Window 10 · MuhammadBilalYar/Hadoop-On-Window Wiki · GitHub

3. Open cmd and typing command "hdfs namenode –format" . You will see

Testing
1. Open cmd and change directory to "C:\Hadoop-2.8.0\sbin" and type "start-all.cmd" to start
apache.

2. Make sure these apps are running

Hadoop Namenode
Hadoop datanode
YARN Resourc Manager

https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10 8/10
24/09/2018 Step by step Hadoop 2.8.0 installation on Window 10 · MuhammadBilalYar/Hadoop-On-Window Wiki · GitHub

YARN Node Manager

3. Open: http://localhost:8088

https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10 9/10
24/09/2018 Step by step Hadoop 2.8.0 installation on Window 10 · MuhammadBilalYar/Hadoop-On-Window Wiki · GitHub

4. Open: http://localhost:50070

Congratulations, Hadoop installed.

Pages 3

Find a Page…

Home

How to Run Hadoop wordcount MapReduce Example on Windows 10

Step by step Hadoop 2.8.0 installation on Window 10

Clone this wiki locally

https://github.com/MuhammadBilalYar/Hadoop-On-Window.wiki.git

https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10 10/10