Scribd
Upload
39 views8 pages

Big Data Practical 1a

Uploaded by

risingknight17
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
39 views8 pages

Big Data Practical 1a

Uploaded by

risingknight17
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 8

Practical 1: Set up and Configuration Hadoop Using Cloudera.

Aim: Set Up And Configuration Hadoop Using Cloudera Creating A Hdfs System With
Minimum 1 Name Node And 1 Data Nodes Hdfs Commands
Theory:
STEP 1: Download and Install VirtualBox
 Download and install VirtualBox from the https://www.virtualbox.org/.
 Follow the installation steps based on your Windows operating system.

STEP 2: Download Cloudera QuickStart VM


 Go to the Cloudera website and download the Cloudera website for VirtualBox.
 Use this direct link:
https://www.youtube.com/redirect?
event=video_description&redir_token=QUFFLUhqbDF1TW9yQ1M2dWhjdmVSNTVLQjQ3
WFI3WUpzUXxBQ3Jtc0tuREJVSW5UMW9JMTlFSzNVU0FXdkd2WWRwNW5fRHowNC10am
QxZ210QWx3SHZfa3BCeFl1ZmFtNk9xVnJGRkVmZjBFYlIxTjZuaVFYV3RlVy1DV0VXN2Fkd
Gd0aERUQ05weFBiZGRYY3gyXzBNUDA4TQ&q=https%3A%2F
%2Fdownloads.cloudera.com%2Fdemo_vm%2Fvirtualbox%2Fcloudera-quickstart-vm-
5.4.2-0-virtualbox.zip&v=8rsNXdvFqBc (Check the description and click on either
version 5.4.2 or 5.13.0)

 Extract the downloaded zip file to a folder on your system.

STEP 3: Import the Cloudera QuickStart VM into VirtualBox


1. Open VirtualBox.
2. Go to File > Import Appliance.
3. Click Browse and locate the extracted Cloudera QuickStart VM file (with the .ovf or .ova
extension).
4. Follow the prompts to complete the import process.
Double Click on this cloudera quickstart vm

STEP 4: Start the VM and Launch Cloudera Services


 Once the VM is imported, select it from the list and click Start.
 The Cloudera QuickStart VM will boot up and automatically start the required Cloudera
services. This may take a few minutes depending on your system's performance.
Additional Steps: Transfer Files Between Windows (Host) and Cloudera (Guest)
STEP 5: Share a Folder from Windows to Cloudera VM
1. In VirtualBox, go to Settings for the Cloudera VM.
2. Click on Shared Folders.
3. Add a new shared folder:
 Click the + icon.
 Choose a folder on your Windows system (e.g., create a folder on your Desktop).
 Enable Auto-mount and Make Permanent.
4. Click OK.

STEP 6: Access Shared Folder in Cloudera VM


1. Start the Cloudera VM (if it isn't running).
2. Open the Terminal in the Cloudera VM.
3. The shared folder will be mounted under /media/sf_<shared_folder_name>. You can access
it using the terminal or file explorer.
Practical 1b: Installation of MongoDB.

Aim: Set Up and Configuration Hadoop Using Cloudera Creating A Hdfs System With
Minimum 1 Name Node And 1 Data Nodes Hdfs Commands
Theory:
Step 1: Download MongoDB
1. Visit the MongoDB Download Center.
2. Under MongoDB Community Server, select the appropriate version (typically the latest
stable version).
3. Select Windows as the operating system and choose the .msi (Windows Installer) package.
4. Click Download.

Step 2: Install MongoDB


1. Once the .msi file is downloaded, open it to begin the installation process.
2. Choose the Complete setup type to install all necessary components.
3. On the Service Configuration page, ensure that the option Install MongoDB as a Service
is selected (default option). This allows MongoDB to run as a Windows service.
4. Click Next and complete the installation.
Step 3: Add MongoDB to the Windows PATH
1. Open Windows Explorer and navigate to the folder where MongoDB is installed, typically
C:\Program Files\MongoDB\Server\<version>\bin.
2. Copy the path of the bin folder.
3. Right-click on This PC or Computer and select Properties.
4. Click on Advanced system settings > Environment Variables.
5. In the System variables section, find Path, select it, and click Edit.
6. Click New and paste the path to MongoDB's bin folder.
7. Click OK to close all windows.

Step 4: Verify the Installation


1. Open Command Prompt and type: mongod --version
This should return the version of MongoDB installed, confirming the installation is successful.

Step 5: Create Data Directory


1. MongoDB stores data in a default directory, which you need to create.
2. Open Command Prompt and run: mkdir C:\data\db
This creates the directory C:\data\db for MongoDB's data storage.
Step 6: Run MongoDB
1. To start the MongoDB server, open Command Prompt and type: mongod

This will start the MongoDB server and it will listen on port 27017 by default.
2. To interact with MongoDB, open another Command Prompt and type: mongosh

This opens the MongoDB shell where you can execute database commands.

You might also like