How to install Hadoop

thank you

hello everyone welcome back to Ivy's

YouTube channel today I will show how to

configure Hadoop in Windows operating

system

over here I am using Windows based

virtual machine you can use your local

Windows operating system as well before

we configure Hadoop we need to check

Java is installed or not to check it go

to your command prompt and write Java

then press enter to execute it if Java

isn't installed you will see Java is not

recognized as an internal or external

command

to install it Java now go to your web

browser search Oracle Java download

click on this link

then scroll down and choose Java 8.

then click on Windows then download

since my operating system is 64-bit I am

downloading this if your operating

system is 32-bit then you can download

from the other link click on here to

accept the license agreement then click

on download after that Oracle will ask

you to login if you don't have any

account then click on create account

since I have already an account just

provide the credentials and click on

sign in then the download will be

started
before we start to install it fast go to

your local disk drive C and create a

folder name as Java

now let's install Java double click on

the downloaded file

click next

again click next

over here change the path to Java the

newly created folder under C drive

then click next to install Java

click on close to complete the

installation process

now go to program files folder then Java

and cut the jdk folder then paste it in

the Java folder

and delete the Java folder under the

program files
now again go to command line prompt and

write Java and run it it still shows

Java is not found we need to configure

the environment of java so it can be

detected correctly go to search bar

search environment variables then open

it

create a new user variable

where user name is Java home all caps

for the variable value go to the Java

then jtk then bin folder copy the path

of the folder

and then paste it over here

now click on the path of system variable

then click on edit then create a new

environment variable over here

paste the same GDK bin path over here

after that click on OK and here also to

take effect all the changes now open a

new command line prompt write Java now

it's working

you can check Java version as well now

our Java installation is done now you

have to install the Hadoop so for that

again go back to your browser and search

Apache Hadoop

click on this link then click on

download

we are going to download one version

older than the latest version since it

is more stable

click on binary then click on this link

it will start downloading

we also need WinRAR to unzip it

first I am installing owendra

once it's installed double click to

download Hadoop file and extract it on

the C drive

and rename it as a Hadoop

now open the Hadoop folder then click on

Etc

then right click on Hadoop EnV then

click on edit

over here change the Java jdk path

again we have to create environment path

for Hadoop go to search bar and open

edit environment variables then click on

environment variables

in user variable
create new user variable name as Hadoop

home all caps and provide the Hadoop bin

path in the variable value

again in system variable edit path

create a new environment path Hadoop bin

and has been

and press ok to save it

now go to command prompt to check our

system detect Hadoop or not just write

Hadoop it will print the all commands

for Hadoop

let's check the Hadoop version from here

and you can see that Hadoop 3.2.4 is

running

so our Hadoop is detected now we have to

configure Hadoop to run it in our system

first go to Hadoop folder then Etc then

again Hadoop folder and right click on

the core site XML file then edit it now

in configuration you have add one

property which should have name and

value

I'm just copy this in a notepad we need

to write this many more time

now in coresight XML write in the name

as FS dot default FS FS will be capital

then in the value section I give the

localhost part hdfs localhost 9000.

now press Ctrl s to save it and close it

after that we need to edit hdfs site dot

XML or

httpsside.xml either one will work

now again write a property with the name

as a DFS dot replication where the value

will be 1

and create two more properties we have

to give the path of name node and data

node

now go back to your Hadoop folder create

a folder named as data then inside the

data folder created two more folder

named as name node and data node

respectively

after that copy the path of name node

then go back to your XML file give the

property name as DFS dot name node.name

dot directory and the value will be the

path of a name node

same as you have to do with this data

node give the path of the data node

and the name will be dfs.name

node.name.dir

now once it done save it and close it

now again go back how to folder then is

ETC then how to begin

to edit map route site dot XML file

and again copy paste that property

in the name section just write mapreduce

dot framework dot name and the value

will be earn

again save it and close it

finally we need to edit yarn site XML

file

again copy paste the property over here

whose name will be

earn.nodemanager.ox Dash services

and the value will be mapreduce suffer

again we have to create another property

whose name will be

en.nodemanager.aux Services dot

mapreduce dot Shuffle

and the value will be organization org

dot Apache dot hadoop.mapper dot Shuffle

Handler

finally save it and close it

once it's done we have to fix the bin

folder to run Hadoop in Windows

first go to your Hadoop folder and then

delete the bin folder

after that download the bin folder with

this link you can check the description

box for this link

after that extract that bin folder

inside Hado folder now open the bin

folder you will see win utils dot exe

file run this file you will see an

System error 1.dll file is missing now

we need to install it again go back to

your browser and search which dll files

is missing over here msbcr 120 dll file

is missing for me so I am just search it

and download it since my system is

64-bit so I am downloading the 64-bit

version if your system is 32-bit you can

download the 32-bit version once it

downloaded copy this dll file into your

system32 folder

to access that system 32 folder you have

to go to your PC then your local disk

then go to Windows and then scroll down

you will find system32 folder

inside this folder paste that dwl file

now again run this queen utils.exe file

and you see there will be no error

pop-up

once it's done we need to install C plus

plus redistributable for visual studio

for that again go back to your browser

and search

msvc-170 and click on this Microsoft

official link and scroll down and

download the 64-bit version if you are

using 32-bit version

please download that one

once it's downloaded install it click on

I agree then install finally we are done

now go to your search bar Search Command

Prompt and run it as a administrator

first we need to format the name node

just write hdfs space name node space

Dash format

once it's done you will see

over here main node successfully

formatted

now we can launch Hadoop cluster first

go back to root directory riding CD

backslash then write CD Hadoop execute

and then CD has been execute over here

just write start Dash dfs.cmd to start

name node and data node and you will see

new node and data node

is running it is in shutdown
also you can check the running status

from command prompt just write JPS

now we need to start earn writing start

and dash eon.cmd executed

you can visually check Hadoop cluster is

running or not just go to your browser

and write localhost semicolon 9870

you will see the status of Hadoop

cluster

you can check the log

and the files you have uploaded in hdfs

over here

2C results manager just execute

localhost semicolon 808 you will see the

cluster size and number of nodes is

running

that's it for today's video

I am just stopping all the nodes to

writing stop Dash all dot CMD in the

next video I will demonstrate how to

upload a data in hdfs and run a

mapreduce function on topic till then

take care bye bye