Scribd
Upload
40 views

Tutorial InstallationHadoopSingleNodePrerequisite

This document provides instructions for setting up a single-node Hadoop cluster on RedHat Linux. It outlines prerequisites like installing Java 6 and configuring SSH. SSH is required to manage nodes, so the document generates an RSA key pair and copies the public key to the authorized_keys file for passwordless SSH access locally. It also tests the SSH setup by logging into localhost.

Uploaded by

pavan2711
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
40 views

Tutorial InstallationHadoopSingleNodePrerequisite

This document provides instructions for setting up a single-node Hadoop cluster on RedHat Linux. It outlines prerequisites like installing Java 6 and configuring SSH. SSH is required to manage nodes, so the document generates an RSA key pair and copies the public key to the authorized_keys file for passwordless SSH access locally. It also tests the SSH setup by logging into localhost.

Uploaded by

pavan2711
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 4

1

single-node Hadoop Installation Preparation

Last Updated:- 3rd Nov 2012


All software will be in D:\\Software
Verify that VM player is installed else you need to install it.
Start your VM player and start the Hadoop VM Node master
Logon with the following credentials:
root / root123
Create directory hadoop :- mkdir /hadoop
The required steps for setting up a single-node Hadoop cluster using the Hadoop Distributed File System
(HDFS) on RedHat Linux.



Red Hat Linux


Hadoop 1.0.3, released May 2012

Prerequisites
Sun Java 6 Verify java as below.
# java -version
java version "1.6.0_20"
Java(TM) SE Runtime Environment (build 1.6.0_20-b02)
www.hpottech.com

single-node Hadoop Installation Preparation

Java HotSpot(TM) Client VM (build 16.3-b01, mixed mode, sharing)


If Java is not there then installed Java : change directory to /hadoop and run the following
# sh /mnt/hgfs/Hadoopsw/jdk-6u17-linux-i586.bin
Configuring SSH
Hadoop requires SSH access to manage its nodes, i.e. remote machines plus your local machine if you want to use
Hadoop on it .
#su - root
# ssh-keygen -t rsa -P ""
Generating public/private rsa key pair.
Enter file in which to save the key (/home/root/.ssh/id_rsa):
Created directory '/home/root/.ssh'.
Your identification has been saved in /home/root/.ssh/id_rsa.
Your public key has been saved in /home/root/.ssh/id_rsa.pub.
The key fingerprint is:

www.hpottech.com

single-node Hadoop Installation Preparation

9b:82:ea:58:b4:e0:35:d7:ff:19:66:a6:ef:ae:0e:d2 root@ubuntu
The key's randomart image is:
[...snipp...]
The second line will create an RSA key pair with an empty password.
Second, you have to enable SSH access to your local machine with this newly created key.
$ cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys
The final step is to test the SSH setup by connecting to your local machine with the root user. The step is also
needed to save your local machines host key fingerprint to the root users known_hosts file.
$ ssh localhost
The authenticity of host 'localhost (::1)' can't be established.
RSA key fingerprint is d7:87:25:47:ae:02:00:eb:1d:75:4f:bb:44:f9:36:26.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'localhost' (RSA) to the list of known hosts.

www.hpottech.com

single-node Hadoop Installation Preparation

Linux ubuntu 2.6.32-22-generic #33-Ubuntu SMP Wed Apr 28 13:27:30 UTC 2010 i686 GNU/Linux
Ubuntu 10.04 LTS
[...snipp...]
# ssh localhost
Last login: Mon Dec 3 21:36:02 2012 from localhost.localdomain

www.hpottech.com

You might also like